Displays for tintable windows

ABSTRACT

A tintable window is described having a tintable coating, e.g., an electrochromic device coating, for regulating light transmitted through the window. In some embodiments, the window has a transparent display in the window&#39;s viewable region. Transparent displays may be substantially transparent when not in use, or when the window is viewed in a direction facing away from the transparent display. Windows may have sensors for receiving user commands and/or for monitoring environmental conditions. Transparent displays can display graphical user interfaces to, e.g., control window functions. Windows, as described herein, offer an alternative display to conventional projectors, TVs, and monitors. Windows may also be configured to receive, transmit, or block wireless communications from passing through the window. A window control system may share computational resources between controllers (e.g., at different windows). In some cases, the computational resources of the window control system are utilized by other building systems and devices.

CROSS-REFERENCES TO RELATED APPLICATIONS

This application claims benefit of the following US Provisional PatentApplications which are hereby incorporated by reference in theirentirety and for all purposes: Application No. 62/490,457, filed Apr.26, 2017, and titled, “ELECTROCHROMIC WINDOWS WITH TRANSPARENT DISPLAYTECHNOLOGY,” Application No. 62/506,514, filed May 15, 2017, and titled,“ELECTROCHROMIC WINDOWS WITH TRANSPARENT DISPLAY TECHNOLOGY,”Application No. 62/507,704, filed May 17, 2017, and titled,“ELECTROCHROMIC WINDOWS WITH TRANSPARENT DISPLAY TECHNOLOGY,”Application No. 62/523,606, filed Jun. 22, 2017, and titled,“ELECTROCHROMIC WINDOWS WITH TRANSPARENT DISPLAY TECHNOLOGY,” andApplication No. 62/607,618, filed Dec. 19, 2017, and titled,“ELECTROCHROMIC WINDOWS WITH TRANSPARENT DISPLAY TECHNOLOGY FIELD”

BACKGROUND

Electrochromism is a phenomenon in which a material exhibits areversible electrochemically-mediated change in an optical property whenplaced in a different electronic state, typically by being subjected toa voltage change. The optical property is typically one or more ofcolor, transmittance, absorbance, and reflectance.

Electrochromic materials may be incorporated into, for example, windowsfor home, commercial and other uses as thin film coatings on the windowglass. The color, transmittance, absorbance, and/or reflectance of suchwindows may be changed by inducing a change in the electrochromicmaterial, for example, electrochromic windows are windows that can bedarkened or lightened electronically. A small voltage applied to anelectrochromic device of the window will cause them to darken; reversingthe voltage polarity causes them to lighten. This capability allowscontrol of the amount of light that passes through the windows, andpresents an opportunity for electrochromic windows to be used asenergy-saving devices.

While electrochromic devices, and particularly electrochromic windows,are finding acceptance in building designs and construction, they havenot begun to realize their full commercial potential.

SUMMARY

Certain aspects of this disclosure pertain to a window having (1) atleast two lites, (2) an electrochromic device disposed or couples withon one of the lites (3) a transparent display disposed on one of thelites, and (4) a controller configured to control an optical state ofthe electrochromic device and an optical state of the transparentdisplay. The window may be in the form of an insulated glass unit(“IGU”).

In some embodiments, the electrochromic and the transparent display aredisposed on the same lite. In some embodiments, the controller isconfigured to adjust the transparent display between substantiallytransparent and substantially opaque optical states.

In some embodiments, the controller is configured to adjust thetransparent display to a translucent optical state. In some embodiments,the display is a pixelated display, and the controller is alsoconfigured to display an image or a graphical user interface on thepixelated display. For example, a graphical user interface displayingoptions for controlling the optical state of the window or anotherwindow can be displayed. In some embodiments, the transparent display isan organic light emitting diode (OLED) display. An OLED display in someembodiments can be used to provide lighting to an interior or exteriorenvironment.

In some embodiments, the transparent display is an electrowettingdisplay having a plurality of pixels where each pixel has at least onecell that can be oscillated between a transparent state and an opaquestate. In some cases, the cells are configured to oscillate at afrequency of at least about 30 Hertz, and in some cases, at a frequencyof at least about 60 Hertz. In some embodiments, each pixel has a cellthat is substantially white (or substantially black) in its opaquestate. When the pixels of an electrowetting display can be turned white(or an otherwise light color), the window may include a projector thatprojects an image onto the electrowetting display. Some of the pixels ofan electrowetting display may include cells that provide differentcolors from one another in their opaque state.

In some embodiments, the transparent display is a passive coating thatis substantially transparent to an observer but reflects projected lightto form an image. The window may include a projector that projects animage onto the transparent display. A projector may, in some cases, belocated on or within a frame configured to hold the window. In someembodiments, the window includes a light guide that directs the imagefrom the projector to the transparent display.

In some embodiments, the window may include a touch-sensitive screen,e.g., associated with the transparent display. This is one type ofsensor, tactile, but embodiments may include other sensing capabilities.

In some embodiments, the window also includes an environmental sensorconfigured to detect at least one chemical. The environmental sensor mayinclude multiple gas sensors that react differently to different gases.The window controller may be configured to receive data from theenvironmental sensor and have logic for determining a gas based onreactions to the gas by the at least two gas sensors.

In some embodiments, the lite having the disposed or coupled transparentdisplay is configured to be removed from the window. In someembodiments, the controller is configured to control the optical stateof the electrochromic device based on the current optical state of thetransparent display.

In some embodiments, the controller is configured to control the opticalstate of the transparent display based on received user instructions.User instructions can be provided, e.g., from a mobile device incommunication with the controller or from a web-based application. Thewindow in some cases may include a microphone in communication with thecontroller so that the controller can receive audible user instructions.In some case, the window includes a camera in communication with thecontroller and the user instructions are received detecting user motion(e.g., gestures provided by a user). In some case, the window includes atouch sensor (in some cases located on the same lite as a transparentdisplay) disposed on a lite and in communication with the controller,wherein the controller is configured to receive user instructionsprovided by user interaction with the touch sensor.

Another aspect of this disclosure pertains to a window having (1) atleast two lites; (2) an electrochromic device disposed on one of the atleast two lites; (3) an environmental sensor disposed on one of thelites; and (4) a controller configured to control the optical state ofthe electrochromic device and detect and/or quantify the presence of atleast one chemical.

The environmental sensor may be disposed on or coupled to one of thelites. In some cases, it is configured to determine a concentration ofcarbon monoxide, lead, ground-level ozone, particulate matter, nitrogendioxide, and/or sulfur dioxide. In some cases, the environmental sensoris further configured to detect a dust level on a surface of at leastone of the two lites.

Another aspect of this disclosure pertains to a building having: (A) aplurality of windows between the interior and the exterior of thebuilding, where each window has an electrochromic device and atransparent display in the window's viewable region, and where thedisplay is substantially transparent when viewed in at least onedirection for at least one optical state; (B) a communications interfaceconfigured to receive instructions for controlling the optical state ofthe display for each of the plurality of widows; and (C) a plurality ofcontrollers connected via a network that are configured to control theoptical state of the electrochromic device and the display for each ofthe plurality of widows, wherein the controllers are configured tocontrol the display for at least one window based on the receivedinstructions.

In some cases, the communications interface is also configured toreceive instructions for controlling the optical state of theelectrochromic device for at least one of the plurality of windows.

In some cases, at least one of the displays in the building is pixelatedand configured to display an image. The controllers may be configured todisplay images on pixelated display(s) based on the receivedinstructions. In some cases, e.g., signage applications, the controllerscan be configured to display an image such that the image is partitionedacross multiple displays (e.g., a subset of displays on, e.g., one sideof a building) based on received instructions. An image displayed by theat least one pixelated display is visible from the exterior of thebuilding and/or from the exterior of the building depending on theconfiguration.

In some cases, window displays in a building include organic lightemitting diode (OLED) displays or electrowetting displays.Electrowetting displays can, in some embodiments, be adjusted betweensubstantially transparent and substantially opaque optical states. Thiscan allow for the display to act as a privacy curtain. In some cases, atransparent window display may be a passive coating that reflectsprojected light.

In some cases, the communications interface in the building isconfigured to receive instructions via the internet or via a mobiledevice. The communications interface, in some embodiments, includes oneor more sensors in communication with the plurality of controllers thatare configured to receive audible instructions, touch-basedinstructions, and/or gesture-based instructions.

These and other features of the disclosure will be described in moredetail below.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows a cross-sectional view of an electrochromic device coatingthat may be used in a tintable window

FIG. 2 shows a cross-sectional side view of a tintable windowconstructed as an IGU.

FIG. 3 depicts a window control network provided by of a window controlsystem having one or more tintable windows.

FIG. 4 depicts an electrochromic (EC) window lite, or IGU or laminate,with a transparent display.

FIG. 5 depicts an electrochromic insulated glass unit with an on-glasstransparent display.

FIG. 6 depicts an optically switchable window configured with aprojector for displaying an image on the surface of the opticallyswitchable window.

FIGS. 7 a and 7 b depict a cell of an electrowetting display.

FIG. 8 depicts a multi-cell pixel of an electrowetting display.

FIG. 9 shows an example of an electrochromic window that includes anelectrochromic lite and a display lite.

FIGS. 10 a-10 c depict an electrochromic window with a removable displaylite.

FIGS. 11 a-11 c depict embodiments for attaching a display lite to awindow assembly.

FIG. 12 depicts an electrochromic window and a display lite installed ina display frame.

FIGS. 13 a and 13 b depict a retainer and faster which may be used tosecure a display lite.

FIGS. 14 a-14 c depict retainers and fasteners used to secure a displaylite.

FIG. 15 illustrates one configuration of how the architecture of how anon-glass transparent controller can be implemented.

FIGS. 16 a and 16 b depict an EC IGU with an IGU connector for EC,antenna, and video applications.

FIG. 17 depicts a façade of a building having IGUs with variouscapabilities

FIG. 18 depicts an atmospheric gas sensor that may be located on orassociated with an IGU.

FIGS. 19 a-19 g depict network architectures that may be used by thewindow control system.

FIGS. 20 a-20 c illustrate example graphical user interfaces used inconjunction with proximity and personalization services implements onoptically switchable windows.

FIG. 21 illustrates a window with a transparent display configured forasset tracking.

FIGS. 22 a-22 e depict windows with transparent displays used forbusiness, collaboration, video conferencing, and entertainment purposes.

FIGS. 23 a-23 c illustrate a window network configured to selectivelydeter unauthorized drones from flying around a building via windowtinting and wireless communication jamming.

FIGS. 24 a and 24 b depict windows configured to detect security and/orsafety threats.

FIG. 25 depicts an exploded view of a window configured for RFcommunication and receiving solar power.

FIGS. 26 a and 26 b illustrate how windows can be configured to provideor block RF communication.

FIG. 27 provides a table showing a number of configurations where anelectrochromic window can enable RF communications and/or serve as asignal blocking device.

FIG. 28 illustrates a window that acts as Wi-Fi passive signal blockingapparatus as well as a Wi-Fi repeater.

FIG. 29 depicts a building having windows with exterior facingtransparent displays.

FIGS. 30 a and 30 b cellular infrastructures without and with the use ofbuildings equipped with windows for cellular communication.

FIG. 31 depicts an optically switchable window configured as a bridgebetween one or more networks exterior to a building and one or morenetworks within a building.

DETAILED DESCRIPTION Introduction

The following detailed description is directed to certain embodiments orimplementations for the purposes of describing the disclosed aspects.However, the teachings herein can be applied and implemented in amultitude of different ways. In the following detailed description,references are made to the accompanying drawings. Although the disclosedimplementations are described in sufficient detail to enable one skilledin the art to practice the implementations, it is to be understood thatthese examples are not limiting; other implementations may be used andchanges may be made to the disclosed implementations without departingfrom their spirit and scope. Furthermore, while the disclosedembodiments focus on electrochromic windows (also referred to asoptically switchable windows, tintable and smart windows), the conceptsdisclosed herein may apply to other types of switchable optical devicesincluding, for example, liquid crystal devices and suspended particledevices, among others. For example, a liquid crystal device or asuspended particle device, rather than an electrochromic device, couldbe incorporated into some or all of the disclosed implementations.Additionally, the conjunction “or” is intended herein in the inclusivesense where appropriate unless otherwise indicated; for example, thephrase “A, B or C” is intended to include the possibilities of “A,” “B,”“C,” “A and B,” “B and C,” “A and C” and “A, B, and C.”

Tintable windows—A tintable window (sometimes referred to as anoptically switchable window) is a window that exhibits a controllableand reversible change in an optical property when a stimulus is applied,e.g., an applied voltage. Tintable windows can be used to controllighting conditions and the temperature within a building by regulatingthe transmission of solar energy and thus heat load imposed on theinterior of the building. The control may be manual or automatic and maybe used for maintaining occupant comfort while reducing the energyconsumption of heating, air conditioning and/or lighting systems. Insome cases, tintable windows may be responsive to environmental sensorsand user control. In this application, tintable windows are mostfrequently described with reference to electrochromic windows locatedbetween the interior and the exterior of a building or structure.However, this need not be the case. Tintable windows may operate usingliquid crystal devices, suspended particle devices,microelectromechanical systems (MEMS) devices (such as microshutters),or any technology known now, or later developed, that is configured tocontrol light transmission through a window. Windows with MEMS devicesfor tinting are further described in U.S. patent application Ser. No.14/443,353, filed May 15, 2015, and titled “MULTI-PANE WINDOWS INCLUDINGELECTROCHROMIC DEVICES AND ELECTROMECHANICAL SYSTEMS DEVICES,” which isherein incorporated by reference in its entirety. In some cases,tintable windows can be located within the interior of a building, e.g.,between a conference room and a hallway. In some cases, tintable windowscan be used in automobiles, trains, aircraft, and other vehicles in lieuof a passive or non-tinting window.

Electrochromic (EC) device coatings—An EC device coating (sometimesreferred to as an EC device (ECD) is a coating comprising at least onelayer of electrochromic material that exhibits a change from one opticalstate to another when an electric potential is applied across the ECdevice. The transition of the electrochromic layer from one opticalstate to another optical state can be caused by reversible ion insertioninto the electrochromic material (for example, by way of intercalation)and a corresponding injection of charge-balancing electrons. In someinstances, some fraction of the ions responsible for the opticaltransition is irreversibly bound up in the electrochromic material. Inmany EC devices, some or all of the irreversibly bound ions can be usedto compensate for “blind charge” in the material. In someimplementations, suitable ions include lithium ions (Li+) and hydrogenions (H+) (i.e., protons). In some other implementations, other ions canbe suitable. Intercalation of lithium ions, for example, into tungstenoxide (WO_(3−y)(0<y≤˜0.3)) causes the tungsten oxide to change from atransparent state to a blue state. EC device coatings as describedherein are located within the viewable portion of the tintable windowsuch that the tinting of the EC device coating can be used to controlthe optical state of the tintable window.

A schematic cross-section of an electrochromic device 100 in accordancewith some embodiments is shown in FIG. 1 . The EC device coating isattached to a substrate 102, a transparent conductive layer (TCL) 104,an electrochromic layer (EC) 106 (sometimes also referred to as acathodically coloring layer or a cathodically tinting layer), an ionconducting layer or region (IC) 108, a counter electrode layer (CE) 110(sometimes also referred to as an anodically coloring layer oranodically tinting layer), and a second TCL 114. Elements 104, 106, 108,110, and 114 are collectively referred to as an electrochromic stack120. A voltage source 116 operable to apply an electric potential acrossthe electrochromic stack 120 effects the transition of theelectrochromic coating from, e.g., a clear state to a tinted state. Inother embodiments, the order of layers is reversed with respect to thesubstrate. That is, the layers are in the following order: substrate,TCL, counter electrode layer, ion conducting layer, electrochromicmaterial layer, TCL.

In various embodiments, the ion conductor region 108 may form from aportion of the EC layer 106 and/or from a portion of the CE layer 110.In such embodiments, the electrochromic stack 120 may be deposited toinclude cathodically coloring electrochromic material (the EC layer) indirect physical contact with an anodically coloring counter electrodematerial (the CE layer). The ion conductor region 108 (sometimesreferred to as an interfacial region, or as an ion conductingsubstantially electronically insulating layer or region) may then formwhere the EC layer 106 and the CE layer 110 meet, for example throughheating and/or other processing steps. Electrochromic devices fabricatedwithout depositing a distinct ion conductor material are furtherdiscussed in U.S. patent application Ser. No. 13/462,725, filed May 2,2012, and titled “ELECTROCHROMIC DEVICES,” which is herein incorporatedby reference in its entirety. In some embodiments, an EC device coatingmay also include one or more additional layers such as one or morepassive layers. For example, passive layers can be used to improvecertain optical properties, to provide moisture or to provide scratchresistance. These or other passive layers also can serve to hermeticallyseal the EC stack 120. Additionally, various layers, includingtransparent conducting layers (such as 104 and 114), can be treated withanti-reflective or protective oxide or nitride layers.

In certain embodiments, the electrochromic device reversibly cyclesbetween a clear state and a tinted state. In the clear state, apotential is applied to the electrochromic stack 120 such that availableions in the stack that can cause the electrochromic material 106 to bein the tinted state reside primarily in the counter electrode 110. Whenthe potential applied to the electrochromic stack is reversed, the ionsare transported across the ion conducting layer 108 to theelectrochromic material 106 and cause the material to enter the tintedstate.

It should be understood that the reference to a transition between aclear state and tinted state is non-limiting and suggests only oneexample, among many, of an electrochromic transition that may beimplemented. Unless otherwise specified herein, whenever reference ismade to a clear-tinted transition, the corresponding device or processencompasses other optical state transitions such asnon-reflective-reflective, transparent-opaque, etc. Further, the terms“clear” and “bleached” refer to an optically neutral state, e.g.,untinted, transparent or translucent. Still further, unless specifiedotherwise herein, the “color” or “tint” of an electrochromic transitionis not limited to any particular wavelength or range of wavelengths. Asunderstood by those of skill in the art, the choice of appropriateelectrochromic and counter electrode materials governs the relevantoptical transition.

In certain embodiments, all of the materials making up electrochromicstack 120 are inorganic, solid (i.e., in the solid state), or bothinorganic and solid. Because organic materials tend to degrade overtime, particularly when exposed to heat and UV light as tinted buildingwindows are, inorganic materials offer the advantage of a reliableelectrochromic stack that can function for extended periods of time.Materials in the solid state also offer the advantage of not havingcontainment and leakage issues, as materials in the liquid state oftendo. It should be understood that any one or more of the layers in thestack may contain some amount of organic material, but in manyimplementations, one or more of the layers contain little or no organicmatter. The same can be said for liquids that may be present in one ormore layers in small amounts. It should also be understood that solidstate material may be deposited or otherwise formed by processesemploying liquid components such as certain processes employing sol-gelsor chemical vapor deposition.

FIG. 2 shows a cross-sectional view of an example tintable window takingthe form of an insulated glass unit (“IGU”) 200 in accordance with someimplementations. Generally speaking, unless stated otherwise, the terms“IGU,” “tintable window,” and “optically switchable window” are usedinterchangeably. This depicted convention is generally used, forexample, because it is common and because it can be desirable to haveIGUs serve as the fundamental constructs for holding electrochromicpanes (also referred to as “lites”) when provided for installation in abuilding. An IGU lite or pane may be a single substrate or amulti-substrate construct, such as a laminate of two substrates. IGUs,especially those having double- or triple-pane configurations, canprovide a number of advantages over single pane configurations; forexample, multi-pane configurations can provide enhanced thermalinsulation, noise insulation, environmental protection and/or durabilitywhen compared with single-pane configurations. A multi-paneconfiguration also can provide increased protection for an ECD, forexample, because the electrochromic films, as well as associated layersand conductive interconnects, can be formed on an interior surface ofthe multi-pane IGU and be protected by an inert gas fill in the interiorvolume, 208, of the IGU. The inert gas fill provides at least some ofthe (heat) insulating function of an IGU. Electrochromic IGU's haveadded heat blocking capability by virtue of a tintable coating thatabsorbs (or reflects) heat and light.

FIG. 2 more particularly shows an example implementation of an IGU 200that includes a first pane 204 having a first surface S1 and a secondsurface S2. In some implementations, the first surface S1 of the firstpane 204 faces an exterior environment, such as an outdoors or outsideenvironment. The IGU 200 also includes a second pane 206 having a firstsurface S3 and a second surface S4. In some implementations, the secondsurface S4 of the second pane 206 faces an interior environment, such asan inside environment of a home, building or vehicle, or a room orcompartment within a home, building or vehicle.

In some implementations, each of the first and the second panes 204 and206 are transparent or translucent—at least to light in the visiblespectrum. For example, each of the panes 204 and 206 can be formed of aglass material and especially an architectural glass or othershatter-resistant glass material such as, for example, a silicon oxide(SO_(x))-based glass material. As a more specific example, each of thefirst and the second panes 204 and 206 can be a soda-lime glasssubstrate or float glass substrate. Such glass substrates can becomposed of, for example, approximately 75% silica (SiO₂) as well asNa₂O, CaO, and several minor additives. However, each of the first andthe second panes 204 and 206 can be formed of any material havingsuitable optical, electrical, thermal, and mechanical properties. Forexample, other suitable substrates that can be used as one or both ofthe first and the second panes 204 and 206 can include other glassmaterials as well as plastic, semi-plastic and thermoplastic materials(for example, poly(methyl methacrylate), polystyrene, polycarbonate,allyl diglycol carbonate, SAN (styrene acrylonitrile copolymer),poly(4-methyl-1-pentene), polyester, polyamide), or mirror materials. Insome implementations, each of the first and the second panes 204 and 206can be strengthened, for example, by tempering, heating, or chemicallystrengthening.

Generally, each of the first and the second panes 204 and 206, as wellas the IGU 200 as a whole, is a rectangular solid. However, in someother implementations other shapes are possible and may be desired (forexample, circular, elliptical, triangular, curvilinear, convex orconcave shapes). In some specific implementations, a length “L” of eachof the first and the second panes 204 and 206 can be in the range ofapproximately 20 inches (in.) to approximately 10 feet (ft.), a width“W” of each of the first and the second panes 204 and 206 can be in therange of approximately 20 in. to approximately 10 ft., and a thickness“T” of each of the first and the second panes 204 and 206 can be in therange of approximately 0.3 millimeters (mm) to approximately 10 mm(although other lengths, widths or thicknesses, both smaller and larger,are possible and may be desirable based on the needs of a particularuser, manager, administrator, builder, architect or owner). In exampleswhere thickness T of substrate 204 is less than 3 mm, typically thesubstrate is laminated to an additional substrate which is thicker andthus protects the thin substrate 204. Additionally, while the IGU 200includes two panes (204 and 206), in some other implementations, an IGUcan include three or more panes. Furthermore, in some implementations,one or more of the panes can itself be a laminate structure of two,three, or more layers or sub-panes.

The first and second panes 204 and 206 are spaced apart from one anotherby a spacer 218, which is typically a frame structure, to form aninterior volume 208. In some implementations, the interior volume isfilled with Argon (Ar), although in some other implementations, theinterior volume 108 can be filled with another gas, such as anothernoble gas (for example, krypton (Kr) or xenon (Xn)), another (non-noble)gas, or a mixture of gases (for example, air). Filling the interiorvolume 208 with a gas such as Ar, Kr, or Xn can reduce conductive heattransfer through the IGU 200 because of the low thermal conductivity ofthese gases as well as improve acoustic insulation due to theirincreased atomic weights. In some other implementations, the interiorvolume 208 can be evacuated of air or other gas. Spacer 218 generallydetermines the height “C” of the interior volume 208; that is, thespacing between the first and the second panes 204 and 206. In FIG. 2 ,the thickness of the ECD, sealant 220/222 and bus bars 226/228 is not toscale; these components are generally very thin but are exaggerated herefor ease of illustration only. In some implementations, the spacing “C”between the first and the second panes 204 and 206 is in the range ofapproximately 6 mm to approximately 30 mm. The width “D” of spacer 218can be in the range of approximately 5 mm to approximately 25 mm(although other widths are possible and may be desirable).

Although not shown in the cross-sectional view, spacer 218 is generallya frame structure formed around all sides of the IGU 200 (for example,top, bottom, left and right sides of the IGU 200). For example, spacer218 can be formed of a foam or plastic material. However, in some otherimplementations, spacers can be formed of metal or other conductivematerial, for example, a metal tube or channel structure having at least3 sides, two sides for sealing to each of the substrates and one side tosupport and separate the lites and as a surface on which to apply asealant, 224. A first primary seal 220 adheres and hermetically sealsspacer 218 and the second surface S2 of the first pane 204. A secondprimary seal 222 adheres and hermetically seals spacer 218 and the firstsurface S3 of the second pane 206. In some implementations, each of theprimary seals 220 and 222 can be formed of an adhesive sealant such as,for example, polyisobutylene (PIB). In some implementations, IGU 200further includes secondary seal 224 that hermetically seals a borderaround the entire IGU 200 outside of spacer 218. To this end, spacer 218can be inset from the edges of the first and the second panes 204 and206 by a distance “E.” The distance “E” can be in the range ofapproximately 4 mm to approximately 8 mm (although other distances arepossible and may be desirable). In some implementations, secondary seal224 can be formed of an adhesive sealant such as, for example, apolymeric material that resists water and that adds structural supportto the assembly, such as silicone, polyurethane and similar structuralsealants that form a watertight seal.

In the implementation shown in FIG. 2 , an ECD 210 is formed on thesecond surface S2 of the first pane 204. In some other implementations,ECD 210 can be formed on another suitable surface, for example, thefirst surface S1 of the first pane 204, the first surface S3 of thesecond pane 206 or the second surface S4 of the second pane 206. The ECD210 includes an electrochromic (“EC”) stack 212, which itself mayinclude one or more layers as described with reference to FIG. 1 .

Window Controllers—Window controllers are associated with one or moretintable windows and are configured to control a window's optical stateby applying a stimulus to the window—e.g., by applying a voltage or acurrent to an EC device coating. Window controllers as described hereinmay have many sizes, formats, and locations with respect to theoptically switchable windows they control. Typically, the controllerwill be attached to a lite of an IGU or laminate but it can also be in aframe that houses the IGU or laminate or even in a separate location. Aspreviously mentioned, a tintable window may include one, two, three ormore individual electrochromic panes (an electrochromic device on atransparent substrate). Also, an individual pane of an electrochromicwindow may have an electrochromic coating that has independentlytintable zones. A controller as described herein can control allelectrochromic coatings associated with such windows, whether theelectrochromic coating is monolithic or zoned.

If not directly, attached to a tintable window, IGU, or frame, thewindow controller is generally located in proximity to the tintablewindow. For example, a window controller may be adjacent to the window,on the surface of one of the window's lites, within a wall next to awindow, or within a frame of a self-contained window assembly. In someembodiments, the window controller is an “in situ” controller; that is,the controller is part of a window assembly, an IGU or a laminate, andmay not have to be matched with the electrochromic window, andinstalled, in the field, e.g., the controller travels with the window aspart of the assembly from the factory. The controller may be installedin the window frame of a window assembly, or be part of an IGU orlaminate assembly, for example, mounted on or between panes of the IGUor on a pane of a laminate. In cases where a controller is located onthe visible portion of an IGU, at least a portion of the controller maybe substantially transparent. Further examples of on glass controllersare provided in U.S. patent application Ser. No. 14/951,410, filed Nov.14, 2015, and titled “SELF CONTAINED EC IGU,” which is hereinincorporated by reference in its entirety. In some embodiments, alocalized controller may be provided as more than one part, with atleast one part (e.g., including a memory component storing informationabout the associated electrochromic window) being provided as a part ofthe window assembly and at least one other part being separate andconfigured to mate with the at least one part that is part of the windowassembly, IGU or laminate. In certain embodiments, a controller may bean assembly of interconnected parts that are not in a single housing,but rather spaced apart, e.g., in the secondary seal of an IGU. In otherembodiments the controller is a compact unit, e.g., in a single housingor in two or more components that combine, e.g., a dock and housingassembly, that is proximate the glass, not in the viewable area, ormounted on the glass in the viewable area.

In one embodiment, the window controller is incorporated into or ontothe IGU and/or the window frame prior to installation of the tintablewindow, or at least in the same building as the window. In oneembodiment, the controller is incorporated into or onto the IGU and/orthe window frame prior to leaving the manufacturing facility. In oneembodiment, the controller is incorporated into the IGU, substantiallywithin the secondary seal. In another embodiment, the controller isincorporated into or onto the IGU, partially, substantially, or whollywithin a perimeter defined by the primary seal between the sealingseparator and the substrate.

Having the controller as part of an IGU and/or a window assembly, theIGU can possess logic and features of the controller that, e.g., travelswith the IGU or window unit. For example, when a controller is part ofthe IGU assembly, in the event the characteristics of the electrochromicdevice(s) change over time (e.g., through degradation), acharacterization function can be used, for example, to update controlparameters used to drive tint state transitions. In another example, ifalready installed in an electrochromic window unit, the logic andfeatures of the controller can be used to calibrate the controlparameters to match the intended installation, and for example ifalready installed, the control parameters can be recalibrated to matchthe performance characteristics of the electrochromic pane(s).

In other embodiments, a controller is not pre-associated with a window,but rather a dock component, e.g., having parts generic to anyelectrochromic window, is associated with each window at the factory.After window installation, or otherwise in the field, a second componentof the controller is combined with the dock component to complete theelectrochromic window controller assembly. The dock component mayinclude a chip which is programmed at the factory with the physicalcharacteristics and parameters of the particular window to which thedock is attached (e.g., on the surface which will face the building'sinterior after installation, sometimes referred to as surface 4 or“S4”). The second component (sometimes called a “carrier,” “casing,”“housing,” or “controller”) is mated with the dock, and when powered,the second component can read the chip and configure itself to power thewindow according to the particular characteristics and parameters storedon the chip. In this way, the shipped window need only have itsassociated parameters stored on a chip, which is integral with thewindow, while the more sophisticated circuitry and components can becombined later (e.g., shipped separately and installed by the windowmanufacturer after the glazier has installed the windows, followed bycommissioning by the window manufacturer). Various embodiments will bedescribed in more detail below. In some embodiments, the chip isincluded in a wire or wire connector attached to the window controller.Such wires with connectors are sometimes referred to as pigtails.

As discussed, an “IGU” includes two (or more) substantially transparentsubstrates, for example, two panes of glass, where at least onesubstrate includes an electrochromic device disposed thereon, and thepanes have a separator disposed between them. An IGU is typicallyhermetically sealed, having an interior region that is isolated from theambient environment. A “window assembly” may include an IGU or forexample a stand-alone laminate, and includes electrical leads forconnecting the IGUs or laminates one or more electrochromic devices to avoltage source, switches and the like, and may include a frame thatsupports the IGU or laminate. A window assembly may include a windowcontroller as described herein, and/or components of a window controller(e.g., a dock).

As used herein, the term outboard means closer to the outsideenvironment, while the term inboard means closer to the interior of abuilding. For example, in the case of an IGU having two panes, the panelocated closer to the outside environment is referred to as the outboardpane or outer pane, while the pane located closer to the inside of thebuilding is referred to as the inboard pane or inner pane. As labeled inFIG. 2 , the different surfaces of the IGU may be referred to as S1, S2,S3, and S4 (assuming a two-pane IGU). S1 refers to the exterior-facingsurface of the outboard lite (i.e., the surface that can be physicallytouched by someone standing outside). S2 refers to the interior-facingsurface of the outboard lite. S3 refers to the exterior-facing surfaceof the inboard lite. S4 refers to the interior-facing surface of theinboard lite (i.e., the surface that can be physically touched bysomeone standing inside the building). In other words, the surfaces arelabeled S1-S4, starting from the outermost surface of the IGU andcounting inwards. In cases where an IGU includes three panes, this sametrend holds (with S6 being the surface that can be physically touched bysomeone standing inside the building). In certain embodiments employingtwo panes, the electrochromic device (or other optically switchabledevice) is disposed on S3.

Further examples of window controllers and their features are presentedin U.S. patent application Ser. No. 13/449,248, filed Apr. 17, 2012, andtitled “CONTROLLER FOR OPTICALLY-SWITCHABLE WINDOWS”; U.S. patentapplication Ser. No. 13/449,251, filed Apr. 17, 2012, and titled“CONTROLLER FOR OPTICALLY-SWITCHABLE WINDOWS”; U.S. patent applicationSer. No. 15/334,835, filed Oct. 26, 2016, and titled “CONTROLLERS FOROPTICALLY-SWITCHABLE DEVICES”; and International Patent Application No.PCT/US17/20805, filed Mar. 3, 2017, and titled “METHOD OF COMMISSIONINGELECTROCHROMIC WINDOWS,” each of which is herein incorporated byreference in its entirety

Window Control System—When a building is outfitted with tintablewindows, window controllers may be connected to one another and/or otherentities via a communications network sometimes referred to as a windowcontrol network or a window network. The network and the various devices(e.g., controllers and sensors) that are connected via the network(e.g., wired or wireless power transfer and/or communication) arereferred to herein as a window control system. Window control networksmay provide tint instructions to window controllers, provide windowinformation to master controllers or other network entities, and thelike. Examples of window information include current tint state or otherinformation collected by window controller. In some cases, a windowcontroller has one or more associated sensors including, for example, aphotosensor, a temperature sensor, an occupancy sensor, and/or gassensors that provide sensed information over the network. In some cases,information transmitted over a window communication network need notimpact window control. For example, information received at a firstwindow configured to receive a WiFi or LiFi signal may be transmittedover the communication network to a second window configured towirelessly broadcast the information as, e.g., a WiFi or LiFi signal. Awindow control network need not be limited to providing information forcontrolling tintable windows, but may also be able to communicateinformation for other devices interfacing with the communicationsnetwork such as HVAC systems, lighting systems, security systems,personal computing devices, and the like.

FIG. 3 provides an example of a control network 301 of a window controlsystem 300. The network may distribute both control instructions andfeedback, as well as serving as a power distribution network. A mastercontroller 302 communicates and functions in conjunction with multiplenetwork controllers 304, each of which network controllers is capable ofaddressing a plurality of window controllers 306 (sometimes referred toherein as leaf controllers) that apply a voltage or current to controlthe tint state of one or more optically switchable windows 308.Communication controllers (304, 306, and 308) may occur via wired (e.g.,Ethernet) or via a wireless (e.g., WiFi or LiFi) connection. In someimplementations, the master controller issues the high-levelinstructions (such as the final tint states of the electrochromicwindows) to the network controllers, and the network controllers thencommunicate the instructions to the corresponding window controllers.Typically a master controller is configured to communicate with one ormore outward face networks 309. Window control network 301 can includeany suitable number of distributed controllers having variouscapabilities or functions and need not be arranged in the hierarchicalstructure depicted in FIG. 3 . As discussed elsewhere herein, network301 may also be used as a communication network between distributedcontrollers (e.g., 302, 304, 306) that act as communication nodes toother devices or systems (e.g., 309).

In some embodiments, outward facing network 309 is part of or connectedto a building management system (BMS). A BMS is a computer-based controlsystem that can be installed in a building to monitor and control thebuilding's mechanical and electrical equipment. A BMS may be configuredto control the operation of HVAC systems, lighting systems, powersystems, elevators, fire systems, security systems, and other safetysystems. BMSs are frequently used in large buildings where they functionto control the environment within the building. For example, a BMS maymonitor and control the lighting, temperature, carbon dioxide levels,and humidity within the building. In doing so, a BMS may control theoperation of furnaces, air conditioners, blowers, vents, gas lines,water lines, and the like. To control a building's environment, the BMSmay turn on and off these various devices according to rules establishedby, for example, a building administrator. One function of a BMS is tomaintain a comfortable environment for the occupants of a building. Insome implementations, a BMS can be configured not only to monitor andcontrol building conditions, but also to optimize the synergy betweenvarious systems—for example, to conserve energy and lower buildingoperation costs. In some implementations, a BMS can be configured with adisaster response. For example, a BMS may initiate the use of backupgenerators and turn off water lines and gas lines. In some cases, a BMShas a more focused application—e.g., simply controlling the HVACsystem—while parallel systems such as lighting, tintable window, and/orsecurity systems stand alone or interact with the BMS.

In some embodiments, network 309 is a remote network. For example,network 309 may operate in the cloud or on a device remote from thebuilding having the optically switchable windows. In some embodiments,network 309 is a network that provides information or allows control ofoptically switchable windows via a remote wireless device. In somecases, network 309 includes seismic event detection logic. Furtherexamples of window control systems and their features are presented inU.S. patent application Ser. No. 15/334,832, filed Oct. 26, 2016, andtitled “CONTROLLERS FOR OPTICALLY-SWITCHABLE DEVICES” and InternationalPatent Application No. PCT/US17/62634, filed on Nov. 23, 2016, andtitled “AUTOMATED COMMISSIONING OF CONTROLLERS IN A WINDOW NETWORK,”both of which are herein incorporated by reference in its entirety.

Electrochromic Windows with Transparent Display Technology

Applicant has previously developed IGUs with integrated photovoltaics,onboard storage, integrated antennas, integrated sensors, an API toserve up valuable data, etc. It has been found that electrochromicwindows can be further improved in surprising ways, e.g., by combiningwith transparent display technology as well as augmenting sensor,onboard antenna, and software applications.

One embodiment, depicted in FIG. 4 , includes an electrochromic (EC)window lite, or IGU or laminate, combined with a transparent display.The transparent display area may be co-extensive with the EC windowviewable area. An electrochromic lite, 410, including a transparent panewith an electrochromic device coating thereon and bus bars for applyingdriving voltage for tinting and bleaching, is combined with atransparent display panel, 420, in a tandem fashion. In this example,410 and 420 are combined using a sealing spacer, 430, to form an IGU,400. The transparent display may be a standalone lite for the IGU, or bee.g. a flexible panel laminated or otherwise attached to a glass lite,and that combination is the other lite of the IGU. In typicalembodiments, the transparent display is the, or is on the, inboard liteof the IGU, for use by the building occupants. In other embodiments, anelectrochromic device coating and transparent display mechanism arecombined on a single substrate. In other embodiments, a laminate, ratherthan an IGU, are formed from 410 and 420, without a sealing spacer.

The transparent display can be used for many purposes. For example, thedisplay can be used for conventional display or projection screenpurposes, such as displaying video, presentations, digital media,teleconferencing, web-based meetings including video, security warningsto occupants and/or people outside the building (e.g., emergencyresponse personnel) and the like. The transparent display can also beused for displaying controls for the display, the electrochromic window,an electrochromic window control system, an inventory management system,a security system, a building management system, and the like. Incertain embodiments, the transparent display can be used as a physicalalarm element. That is, the electrochromic lite of an IGU can be used asa breakage detector to indicate a security breach of the building'sperimeter. The transparent display could also, alone or in combinationwith the electrochromic lite, serve this function. In one example, theelectrochromic lite is used as a breakage detection sensor, i.e.,breaking the EC pane triggers an alarm. The transparent display may alsoserve this function, and/or be used as a visual alarm indicator, e.g.,displaying information to occupants and/or external emergency personnel.For example, in certain implementations, a transparent display may havea faster electrical response than the electrochromic lite, and thuscould be used to indicate alarm status, for example, externally tofirefighters, etc. or internally to occupants, e.g., to indicate thenature of the threat and/or escape routes. In one embodiment, breakageof the outboard electrochromic lite sends a signal to the transparentdisplay, via the window controller, such that the transparent displayconveys a security breach. In one embodiment, the transparent displayflashes a warning message and/or flashes red, e.g., the entiretransparent display pane may flash brightly in red to indicate troubleand be easily seen, e.g., a large window flashing in this manner wouldbe easily noticeable to occupants and/or outside personnel. In anotherexample, one or more neighboring windows may indicate damage to awindow. For example, in a curtain wall where a first window has fouradjacent windows, breakage to the first window triggers one or more ofthe four adjacent windows to flash red or display large arrows pointingto the first window, to make it easier for occupants or externalpersonnel to know where the trouble is. In a large skyscraper, with manywindows, it would be very easy for first responders to see four windowsadjacent a central window flashing, i.e., forming a flashing cross toindicate where the trouble is located. If more than one window isbroken, this method would allow instant visual confirmation of where thetrouble lies. In certain embodiments, one or more transparent displaysmay be used to display a message to first responders, indicating boththe location and nature of the emergency. It may be breakage of one ormore windows or indicate, e.g., hotspots within the building forfirefighters.

The electrochromic window can be used as a contrast element to aidvisualization of the transparent display, e.g., by tinting the EC panethe transparent display will have higher contrast. In turn, thetransparent display can be used to augment the color, hue, % T,switching speed, etc. of the electrochromic device. There are many novelsymbiotic relationships that can be exploited by the combination of ECwindow and transparent display technology. When the EC pane and thetransparent display are both in their clear state, IGU 400 appears andfunctions as a conventional window. Transparent display 420 may havesome visually discernable conductive grid pattern but otherwise istransparent, and can be uni- or bidirectional in the display function.One of ordinary skill in the art would appreciate that as transparentdisplay technology advances, the clarity and transparency of suchdevices will improve. Improvements in micro and nanostructuredaddressable grids, as well as transparent conductor technology, allowfor transparent displays where there is no visually discernableconductive grid.

FIG. 5 depicts an electrochromic insulated glass unit, 550, with anon-glass transparent display, 575, used as a control interface for IGU550. Display 575 may be wired to an onboard controller which is, e.g.,housed in the secondary sealing volume of the IGU. The wiring for thetransparent display 575 may pass through the glass, around the edge ofthe glass, or may be wirelessly connected to the onboard (or offboard)controller (not shown). When the transparent display 575 is not in use,it is essentially transparent and colorless, so as not to detract fromthe aesthetics of the IGU's viewable area. Transparent display 575 maybe adhesively attached to the glass of the IGU. Wiring to the controlunit of the window may pass around or through the glass upon which thedisplay is attached. The display may communicate with a windowcontroller or control system wirelessly via one or more antenna, whichmay also be transparent.

A transparent display may be located within the viewable area of anoptically switchable window. The transparent display may be configuredto provide various types of information about windows or the buildingvia, e.g., a graphical user interface. The display may also be used toconvey information to the user, e.g., teleconferencing, weather data,financial reports, live streaming data, asset tracking and the like asdescribed herein. In certain embodiments, the transparent display (andassociated controller) is configured to show specific information aboutthe window being used (the one displaying the information), informationabout a zone in which the window resides, and/or information about otherparticular windows in the building. Depending on user permissions, suchinformation could include information in all windows of a building oreven multiple buildings. The transparent displays (and associatedcontroller) may be configured to allow monitoring and/or controllingoptically switchable windows on a window network.

In certain embodiments, the graphical user interface may representwindows and/or other controllable systems and devices using smartobjects. A “smart object,” as described herein, is a representation ofone or more material items that can be manipulated by a user (e.g., bycontact with a touch-sensitive display) to gather and/or presentinformation about the one or more physical devices the smart objectrepresents. In some cases, a graphical user interface may display athree-dimensional building model with one or more smart objects thereon.By displaying smart objects on the building model according to theirphysical location, a user in may easily identify a smart object thatrepresents a window of interest. Smart objects allow a user to receiveinformation from, or control an aspect of, the window network and/or asystem or electronic device in communication with the window network.For example, if a user has selected a smart object representing awindow, information may be displayed such as a window ID, window type,window size, manufacturing date, current tint state, leakage current,usage history, inside temperature, outside temperature, and the like.Additionally, smart objects may present a user with options forcontrolling a window tint state, configuring a tint schedule, or tintingrules. In some cases, a window may have inboard lite with touch andgesture sensors that allow a user to interact with smart objects in thegraphical user interface. In some cases, a user may interact with thesmart objects displayed on the graphical user interface using a remotedevice that is configured to receive user input (e.g., a cell phone, acontroller, a keyboard, and the like).

In one example, during the initial installation of a plurality ofelectrochromic windows, at least one window is installed withtransparent display technology. This window may also be configured withpower, internet connectivity, and at least one processor (e.g., a windowcontroller, network controller, and/or master controller for the windowinstallation). The at least one window, by virtue of its transparentdisplay functionality, can serve as a GUI for further installation ofthe plurality of windows in the system to be installed. As the windowsof the system are installed, this use may be translated to other windowsof the system, and, additionally be used to commission windows of thesystem. This obviates the need for an installer to have a portable orother separate computing device for commissioning the windows; thewindow itself and its corresponding processing power can be used duringinstallation to aid further installation and commissioning of the windowsystem. Using, e.g., this at least one window with display technologytradespeople, engineers, and/or construction crews tasked withinstalling electrical wiring, plumbing, HVAC and other infrastructuremay have the ability to pull up building drawings on large formatdisplays, rather than carrying large paper drawings. Moreover, web-basedvideo conferencing e.g., allows workers in disparate areas of thebuilding to communicate with each other and discuss building plansdisplayed on their screens, manipulate the plans interactively via thetouchscreen function of transparent displays described herein.

In certain embodiments, rather than a transparent display registeredwith an EC device, e.g., in an IGU form factor, an interactive projectoris used to both display information onto an EC window and also allow theuser to access and input information using the interactive displaytechnology portion of the assembly. FIG. 6 depicts an example of anoptically switchable window 600 configured with a projector 606 thatdisplays an image 614 on the surface of the optically switchable window.To improve the visibility of a projected image 614, a window may beconfigured with a pixelated or monolithic passive coating that issubstantially transparent to an observer, but aids in the reflection ofthe image provided by the projector. In some cases, the level of tintingmay be adjusted to improve the visibility of a projected image. In thisregard, to ensure that the window tint state is appropriate forprojecting, the window controller 604 and projector/display controller606 may be coupled or in communication. The projector may be located ina mullion 602 (as depicted), a transom, or at a remote location such asa nearby ceiling or a wall. The projector 606 may receive information todisplay from a window controller 604, which may also be located in amullion or a transom. In some cases, a projector in a mullion, transom,or similar location is used to project an image through free space andonto a glass surface or a passive coating of the IGU. In some cases, aprojector is located within the mullion and projects light onto thedisplay via a light guide that is embedded in, formed by, or attached toa glass substrate of a display lite. The projector may in someembodiments be configured so that the end user does not see theprojector mechanism, i.e. it is hidden from view. Light may be projectedfrom the edge of the glass into the light guide, e.g., by using a mirroror by orienting the projector. In this configuration, the projector canbe concealed from view so as not to create a visual distraction. In somecases, a light guide plate is used which runs parallel to a lite whichhas a monolithic passive coating for displaying an image. Examples oflight guide plates used for a user wearable display device which can beadapted for use for transparent displays on optically switchable windowsare found in U.S. Pat. No. 9,791,701B2 titled “Display device,” andfiled on Oct. 17, 2017, which is incorporated in its entirety.

To receive user input corresponding to user motion, the window depictedFIG. 6 may be equipped with motion sensors 608 located on or withinmullions and/or transoms. The motion sensors may include one or morecameras to detect user motion (e.g., the motion of a user's hand) andimage analysis logic may determine a user's interaction with a displayedsmart object based on the detected motion. For example, image analysislogic may determine whether a user's motion corresponds to a gestureused to provide a specific input. In some cases, one or more cameras maybe inferred cameras. In some cases, the motion sensors may includeultrasonic transducers and ultrasonic sensors to determine user motion.In some cases, a window may be equipped with a capacitive touch sensor(e.g., on S1 or S4) that at least partially covers the visible portionof the window and receives user input when a user touches the surface ofthe window. For example, a capacitive touch sensor may be similar tothat found in touchscreens such as the Apple iPad. In addition to motionsensors, an optically switchable window may also be equipped with amicrophone 612 located in a mullion or transom for receiving audibleuser input. In some cases, a microphone 612 may be located on a remotedevice and voice recognition logic may be used to determine user inputfrom received audio. In some cases, audio is recorded on a remote deviceand transmitted wirelessly to a window controller. Examples of systemsthat provide a voice-controlled interface for controlling opticallyswitchable windows are provided in PCT Patent ApplicationPCT/US17/29476, filed on Apr. 25, 2017, which is herein incorporated byreference in its entirety. When a window may be configured to receiveaudible user input, a window may also be configured with one or morespeakers 610 for providing information to a user. For example, a speaker610 may be used respond to a user inquiry or to provide various featuresthat may be controlled by the user. In some cases, a projector such asan Xperia Touch™, manufactured by Sony Corporation, is attached to ornear the IGU, e.g., in a mullion or on a wall or ceiling nearby, inorder to project onto an IGU to display information to the user andprovide an on-glass control function.

In one embodiment, the window assembly includes a motion sensor, acamera, a transparent capacitive touchscreen, and/or a microphone forvoice activation. When a user interacts with the window, the projector(or transparent display) activates to show a control GUI for controllingthe window, other windows in the building, and/or other buildingsystems. The user interaction may be, e.g., movement detected near thewindow, video or image identification of the user, an appropriate touchcommand, and/or an appropriate voice command. The user can then carryout desired work, programming, data retrieval and the like. After aperiod, or by the appropriate command input provided by the user, thecontrol GUI on the glass (projected or transparent display) disappearsor ceases, leaving the (entire) unobstructed view of the window.

In certain embodiments, a window may use an electrowetting displaytechnology. FIG. 7 a depicts a cell 700 of an electrowetting display inan opaque state, and FIG. 7 b depicts the cell in a transparent orsubstantially transparent state. Such displays may have many thousandsor more of such cells, individually addressable, and thus can behigh-resolution transparent displays.

Electrowetting displays make use of the surface tension in liquids andthe electrostatic forces. Electrowetting displays are made of one ormore pixels wherein each pixel represents an area of the display thatcan be controlled to move between two or more substantially uniformoptical states. A cell, as depicted in FIGS. 7 a and 7 b , is bound byan upper substrate 704 (e.g., a glass surface) and a hydrophobicinsulating layer 706 having hydrophobic properties. The hydrophobiclayer 706 separates the cell interior from a transparent displayelectrode 708 and creates an electrowetting surface area. Within thecell, there is a hydrophobic solution 712 and a hydrophilic solution710. The hydrophobic solution 712, sometimes referred to as theelectrowetting oil, is electrically non-conductive and may be, e.g.,hexadecane, hexane, cyclohexane, benzene, xylene, or (silicone) oil. Thehydrophobic solution 712 has a particular color or optical property thatis different from that of the hydrophilic solution 710. In some cases,suspended in the hydrophobic solution is a plurality of particles havingone or more pigments; in some cases, the particles may be white incolor. The particles for coloring may include particles such as titaniumdioxide (TiO2), zinc oxide, or calcium carbonate. The hydrophilicsolution 710 is a transparent or substantially transparent solution thatincludes an electrolyte. The hydrophilic solution 710 is electricallyconductive and often polar It may be, e.g., a water or salt solutionsuch as a solution of potassium chloride in a mixture of water and ethylalcohol. The hydrophobic character of the electrowetting oil causes itadhere preferentially to the hydrophobic insulator 706 (it “wets” theinsulator) when no voltage is applied to the cell resulting in an opaquestate as shown in FIG. 7 a . When an electric field is applied to thecell via the transparent display electrode 708, the interface tension ofthe hydrophilic liquid is changed to move the hydrophobic liquid 712,thereby making the cell transparent or substantially transparent asshown in FIG. 7 b . In some embodiments, the transparent displayelectrodes of adjacent cells may be electrically connected so thatmultiple cells are controlled in unison. In some embodiments, thedisplay electrodes of adjacent cells are electrically isolated fromother so cells can be controlled individually. Sidewalls 714 may be usedto isolate the hydrophobic and/or the hydrophilic solution within acell.

An electrowetting display is formed by a grid of adjacent electrowettingcells that may be individually controlled. The cells of anelectrowetting display may be very small; for example, in someembodiments, electrowetting cells may be less than about 1 mm×about 1mm, and in some cases, cells may be about 100 μm×about 100 μm. Whilesmaller cells may be preferable in situations where image resolution isa concern, in some embodiments cells may be much larger, e.g., greaterthan about 1 cm×about 1 cm or great than about 10 cm×about 10 cm. Whilecells are generally square-like in shape, this need not be the case. Insome embodiments, cells may have a circular shape or a polygonal shape.In some embodiments a cell may be much longer in one dimension than inanother dimension; for example, a cell might be 100 or 1000 times longerin a first dimension in comparison to a second dimension. In someembodiments, an electrowetting display may span the dimensions of an IGUlite, and in some embodiments, an electrowetting display may only fill aportion of lite. When an electrowetting display spans the dimensions ofan IGU, the display may be used to provide shading or privacy. Forexample, if privacy is wanted in a conference room, electrowettingdisplays on one or more windows may be immediately switched from atransparent state to an opaque state—blocking or substantially blockingvisibility into and out of the conference room. In some embodiments,cells may be modulated between transparent and opaque states at afrequency of at least about 30 Hz. In some embodiments, cells may bemodulated between transparent and opaque states at a frequency of atleast about 60 Hz. As discussed herein, an electrowetting display may beassociated with an IGU having an electrochromic device. For example, anelectrowetting display may be located on the interior lite of an IGU. Insome cases, a transparent electrowetting display is located on aseparate lite placed in front of an electrochromic lite and held inplace by the IGU framing structure.

In some embodiments, an electrowetting display may be configured to turna transparent window into a partially or substantially reflective screenon which images can be projected. For example, cells may be white andreflective in their opaque state. In embodiments where the pixels of anelectrowetting display are configured to transition between opticalstates simultaneously (e.g., to provide a projection screen or a privacyscreen) a monolithic electrode may span the dimensions of an IGU and avoltage may be applied to the electrode so that the cells transitionoptical states at the same time. In some cases, a projector locatedwithin a mullion or somewhere else within the room can be used toproject an image onto the display. In some embodiments, anelectrowetting display may be configured to display black pixels. Insome embodiments, images can be seen on an IGU by contrasting black orcolored pixels with the lighter backdrop of an exterior environment tocreate a viewing experience similar to that of a heads-up display. Thismay be useful if a user does not want to obscure a view provided by anIGU. In some cases, the tint of an electrochromic window may be manuallyor automatically adjusted (e.g., to account for glare) to create a highcontrast image that is also comfortable to look at. In some embodiments,an electrowetting display may be configured to display color images onan IGU by using multiple electrowetting cells for each pixel as shown inFIG. 8 .

FIG. 8 depicts multi-cell pixel of an electrowetting display usesparticles of various pigments. The pixel is created by three cells (802,804, and 806) that reflect cyan, magenta, and yellow light in theiropaque states. As depicted, the magenta cell 804 is in an opaque statewhile the cyan cell 802 and yellow cell 806 are in transparent states.As a result, incident light 808 is reflected having a magenta coloredwavelength 810. By oscillating the states of a multi-cell pixel veryquickly at prescribed ratios, the colors may be combined to generatewide gamut of perceptible colors. While a 3-cell pixel is depicted, anelectrowetting display includes pixels having any number of cells. Insome cases, cells may have oils that reflect light having a differentcolor than cyan, magenta, or yellow. In some cases, a pixel may includea cell that absorbs visible light in its opaque state to produce a blackcolor. In some cases, a pixel may include a cell that reflects whitelight in its opaque state. Using multi-cell pixels, various subtractivecolor techniques that are understood well in the art (e.g., in theprinting industry) may be used to a variety of colors.

Electrochromic Window Assemblies

Certain embodiments relate to a system for mounting a transparentdisplay with an electrochromic window. Such systems can be thought of asa docking station or framing system to couple the display and theelectrochromic window. Such systems typically, but not necessarily, areconfigured to route power and communications between the display and theelectrochromic window components. This routing function, and apparatus,may include a combined display and electrochromic window controller.

The display may be permanently or reversibly attached to theelectrochromic window. The electrochromic window may include anelectrochromic lite, an electrochromic IGU, and/or a laminate includingan electrochromic lite, for instance. In some cases, it may beadvantageous to include a reversible and/or accessible connectionbetween the display and the window such that the display can be upgradedor replaced, as needed. For example, a typical electrochromic window mayhave a useful lifespan of several decades, while a display may have amuch shorter lifespan of a handful of years. In such cases, it isbeneficial for the display to be reversibly and/or accessibly mountedfor easy replacement. Similarly, such reversible and/or accessibleconnections can be beneficial as display technology advances andimproves, allowing for the display to be upgraded as desired. As usedherein, a display that is “reversibly” mounted can be removed andreplaced without damaging the electrochromic window. Further, a displaythat is “accessibly” mounted can be removed and replaced withoutdamaging the electrochromic window and without removing theelectrochromic window from its installed location.

Many of the figures herein show the display lite either inboard oroutboard of the electrochromic window. It is noted that any of theembodiments herein can be modified to switch the relative positions ofthe display lite and the electrochromic window (e.g., EC lite, EC IGU,laminate EC lite, etc.). Similarly, any of the embodiments herein can bemodified to provide an electrochromic device on any lite of the window.Therefore, while a particular figure might show the EC IGU outboard of adisplay lite, where the EC lite of the EC IGU is outboard of the secondlite of the EC IGU, it is understood that a similar embodiment may havethe EC IGU inboard of a display lite, and/or may have the EC lite of theEC IGU inboard of the second lite of the EC IGU. Moreover, while certainfigures show an electrochromic window that includes a particular numberof lites, any of these embodiments can be modified such that theelectrochromic window includes any number of lites (e.g., an EC IGU maybe replaced with an EC lite or EC laminate, and vice versa).

FIG. 9 shows an example of an electrochromic window 900 that includes anelectrochromic IGU (including electrochromic lite 901 withelectrochromic device 902 thereon, second lite 903, and an IGU spacer904 separating the electrochromic lite 901 from the second lite 903),and a display lite 905. A controller 906 is housed in the framing 907that surrounds and/or supports the electrochromic window 900. Controller906 includes electrochromic window control functions as well as displaycontrol functions. These functions may be independent or coordinated,depending on the need. For example, activating the display may overridea tint setting of the electrochromic window if a higher contrast isdesired for the displayed information, a privacy mode is desired for thedisplayed information, the displayed information is desired to be seenby persons outside the building, etc.

In certain embodiments, the transparent display, alone or in conjunctionwith the electrochromic device, can be used for privacy applications.For example, an electrochromic device can be adjusted to a dark tintstate to reduce light transmission, and a transparent display (e.g., anelectrowetting display) can be turned to an opaque tint state so thatoutsiders cannot see into the building or room and observe theoccupant's activities. In some cases, a transparent display that emitslight, such as an OLED display, can be used to distract an outsider orotherwise make it more difficult for an outsider to see into a buildingor room. In some cases, transparent displays (for privacy, signage, andother applications) can be located on a separate film or a separate litespaced apart from the defining interior and exterior lites of an IGU. Insome cases, an IGU framing structure may be configured to accept atransparent display that can be installed as an optional feature at alater point in time. For example, an IGU framing structure may beconfigured to accept an externally facing transparent display to userfor signage applications if, e.g., a building owner wishes to receiveadditional advertising income without obstructing an occupant's view.Such displays could then, if only needed temporarily, be moved to adifferent location or building.

In this example, the display lite 905 is reversibly mounted to theelectrochromic IGU through the framing 907. If and when the display lite905 is to be removed and replaced, the framing 907 can be uninstalled,allowing the display lite 905 and the electrochromic IGU to be separatedfrom one another and from the framing 907. This may involve unplugging aconnection between the display lite 907 and the controller 906 (or inother cases, between the display lite 907 and another portion of thewindow such as the EC lite 901 or EC device 902). A new display lite canthen be provided along with the electrochromic IGU within the framing907, and the unit can be re-installed in the building. In some cases, asecond spacer (sometimes referred to as a display spacer, not shown) maybe provided between the second lite 903 and the display lite 905. Thesecond spacer may be used to ensure a uniform distance between thesecond lite 903 and the display lite 905, and, in some embodiments,create a hermetically-sealed volume between the display lite 905 secondlite 903 of the electrochromic IGU, e.g., as an IGU would have. In otherembodiments, the framing 907 supports and provides the appropriatespacing between the EC window and the display. There may be sealingelements (not shown) in framing 907 to prevent dust from entering thevolume between display 905 and the EC IGU.

FIGS. 10 a-10 c show close-up views of one side of an EC window similarto that shown in FIG. 9 , but including a connection between the displaylite 1005 and the electrochromic IGU that is both reversible andaccessible. In this example, the framing 1007 includes one or moremovable components 1008 that allow for insertion and removal of thedisplay lite 1005 without removal of the framing 1007. In other words,this embodiment shows a display lite 1005 that is removable andaccessibly mounted to an electrochromic IGU. If and when the displaylite 1005 is to be removed, the movable component 1008 may rotate,slide, retract, snap, or otherwise move from a first position to asecond position. In the first position, shown in FIG. 10 a , the movablecomponent secures the display lite 1005 in the framing 1007. In thesecond position, shown in FIG. 10 b , the movable component is out ofthe way such that display lite 1005 is no longer secured in the framing1007. The moveable component 1008 may, e.g., rotate away from thedisplay lite so that it can be removed. In FIG. 10 c the movablecomponent 1008 retracts into the main portion of the framing 1007. Asnoted above, the display lite 1005 may be disconnected from anelectrical connection to, e.g., the window controller, EC lite 1001, orEC device 1002, when the display lite 1005 is removed. Movable component1008 may itself be a frame that attaches within the inner perimeter offraming 1007 to secure the display.

FIG. 11 a shows another configuration for attaching a display lite 1105to an electrochromic window 1109. The electrochromic window 1109 mayinclude an electrochromic lite, an electrochromic IGU, and/or a laminatestructure including an electrochromic lite. In this example, framing1107 secures the electrochromic window 1109. A display spacer 1110 ispositioned between the electrochromic window 1109 and the display lite1105. The display spacer 1110 may be adhesively attached to both theelectrochromic window 1109 and the display lite 1105. The display spacer1110 may be peripherally oriented along two or more sides of the window,in many cases along all sides of the window. Additionally, in somecases, one or more support structures may be provided between the edgeof the display lite 1105 and the framing 1107, along one or more edgesof the display lite 1105. In a particular example, a support structure(e.g., a block) may be provided under the bottom edge of the displaylite 1105 such that at least some of the weight of the display lite 1105is supported on the support structure. Flashing (not shown) may beprovided to obscure the edges of the display from view by the occupantof the room. These embodiments allow for a retrofit or “infill” typeapplication of a display to an existing EC IGU such as are described inU.S. patent application Ser. No. 15/528,071, filed May 18, 2017, andtitled “INFILL ELECTROCHROMIC WINDOWS, which is herein incorporated byreference in its entirety. This allows for flexibility, e.g., in thatparticular EC IGUs can be fitted with display technology after the ECIGUs are installed. The existing EC window controller may be swapped outfor a controller that controls both the display and the EC window, or,e.g., EC window controllers may have display control functions that areused when displays are coupled with the EC windows.

FIG. 11 b shows another configuration for attaching a display lite 1105to an electrochromic window 1109. In this example, a first framingsystem 1111 supports/secures the electrochromic window 1109, and asecond framing system 1112 (sometimes referred to as a display frame)supports/secures the display lite 1105 proximate the electrochromicwindow 1109, within the first framing system 1111. In this particularexample, the controller 1106 is positioned within the second framingsystem 1112, though it can be provided at any location onboard oroffboard the window. Controller 1106 may be accessible to the occupant,e.g., having an exposed surface on the inboard surface of the secondframing system 1112. In other embodiments, a GUI for the controller isdisplayed on the display panel 1105. The second framing system 1112 isconfigured to fit within the dimensions of the first framing system1111. The second framing system 1112 may be held in place by frictionand/or by screws, nails, brackets, clips, or any other securinghardware. The second framing system 1112 is removably and accessiblyattached to the first framing system 1111 such that the second framingsystem 1112 can be removed without damage to or removal of the firstframing system 1111 and electrochromic window 1109. There may be a seal(not shown) between the second framing system 1112 and the first framingsystem 1111.

FIG. 11 c shows an embodiment similar to that in FIG. 11 b , butincluding two display lites 1105 installed side-by-side proximate twoelectrochromic windows 1109. The area of the display can be effectivelyincreased by including additional displays, e.g. when a curtain wall orbuilding façade is used to display information in large format, e.g. inadvertising on the outside of the building or to augment interiorinformation display format. Of course, multiple EC/display assemblies,such as depicted below, can be used e.g. to display differentinformation on the same or separate displays, e.g. for slideshows,teleconferencing, asset tracking, EC window control, and the like,simultaneously or not. For example, for a particular curtain wall havingelectrochromic windows, any number of the windows may have displaycomponents, depending upon the needs of the occupants, the buildingowner, etc. The system described allows for flexibility in display/ECwindow configurations, any number of windows among a set of windows canbe fitted with display functionality.

FIG. 12 shows an electrochromic window 1209, a display lite 1205surrounded by a display frame 1212, and a unit that includes both theelectrochromic window 1209 and display lite 1205 installed in thedisplay frame 1212. The display frame 1212 may reversibly and/oraccessibly mount the electrochromic window 1209 therein/thereon. Thedisplay frame 1212 may extend along one side, two sides, three sides,four sides, and/or all sides of the display lite 1205. In some cases, adisplay spacer (not shown) may be provided between the electrochromicwindow 1209 and the display lite 1205, or between the electrochromicwindow 1209 and the display frame 1212. In some cases, the display frame1212 may itself act as a display spacer to maintain a uniform distancebetween the electrochromic window 1209 and the display lite 1205.Display frame 1212 may be unitary or be an assembly of parts, e.g., foursides that attach to form the frame. Frame 1212 may be constructed frommaterials common to the window framing arts, e.g., aluminum, extrudedvinyl, wood, vinyl-wood composites, fiberglass or other common windowframing materials.

In another example, an electrochromic IGU includes two or more lites,where one or more of the lites has an electrochromic device thereon, andone or more of the lites is a display lite. In a particular example, anelectrochromic IGU includes two lites, where one lite is electrochromicand the other is a display lite.

In certain embodiments, a lite and an electrochromic device thereon(e.g., electrochromic lite 901 and electrochromic device 902 shown inFIG. 9 ) may be made from materials that are partially or completelysolid-state and inorganic. These materials are desirable because oftheir reliability and consistent characteristics in comparison toorganic materials that may be susceptible to degradation when exposed toultraviolet radiation and/or heat as a result of solar exposure.Solid-state and inorganic materials are resilient to prolonged sunexposure. Example solid-state electrochromic devices, methods, andapparatus for making them and methods of making electrochromic windowswith such devices are described in U.S. patent application Ser. No.12/645,111, entitled “Fabrication of Low Defectivity ElectrochromicDevices,” by Kozlowski et al., and U.S. patent application Ser. No.12/645,159, entitled “Electrochromic Devices,” by Wang et al., both ofwhich are incorporated by reference herein in their entireties. Invarious embodiments, a solid-state electrochromic device is used inconjunction with a transparent display, which may be pixelated and whichmay include one or more organic or non-solid components. Examples ofsuch displays include OLEDs, electrophoretic displays, LCDs, andelectrowetting displays. As described, the display may be fully orpartially coextensive with an electrochromic device on a lite. Further,the display may be provided in direct on contact with an electrochromicdevice, on the same lite as the electrochromic device but on a differentsurface, or on a different lite of an IGU.

In some embodiments, the electrochromic devices are entirely solid-stateand made in apparatus that allow deposition of one or more layers of thestack in a controlled ambient environment. That is an apparatus wherethe layers are deposited without leaving the apparatus and without, forexample, breaking vacuum between deposition steps, thereby reducingcontaminants and ultimately improving device performance. In certainembodiments, all of the materials making up electrochromic stack areboth inorganic and solid. In some cases, an electrochromic device madeof all solid-state and inorganic materials may filter ultraviolet lightand protect a building's interior from damaging solar rays. In somecases, an IGU having an electrochromic device made from materials thatare all solid-state and inorganic may be placed between a display liteand an exterior environment. In this arrangement, the solid-state andinorganic electrochromic device may reduce or block high energy solarradiation from impacting and potentially damaging a display lite. Forexample, in some embodiments, an all solid-state and inorganicelectrochromic device may block ultraviolet light and protect an OLED oran electrowetting display that is on the interior side of the EC device.

FIG. 13 a shows different views of a retainer 1315 and fastener 1316that may be used to secure a display lite 1305 to a framing 1307 thatsecures the electrochromic window 1309. The retainer 1315 includes anopening through which the fastener 1316 fits to secure the display lite1305 to the framing 1307.

FIG. 13 b shows the retainer 1315 and fastener 1316 shown aboveinstalled in framing 1307. The framing 1307 directly secures theelectrochromic window 1309, and secures the display lite 1305 via theretainer 1315 and fastener 1316. The retainer 1315 can slide into placeover the fastener 1316 when the display lite 1305 is installed, and canslide out of place when the display lite 1305 is to be replaced. Thistype of attachment system has the advantage of not exposing the fastener1316 to the occupant's view and providing a flashing function to hidethe edge of the display panel 1305.

FIG. 14 a-14 c show other examples of a retainer 1415 and fastener 1416.In FIG. 14 c the retainer has dimensions D1, D2, and D3, as shown. Thesedimensions should be sufficiently large to adequately secure the displaylite 1415, and should be sufficiently small to block an acceptably smallamount of viewable area.

In some embodiments, the display lite may reversibly and accessiblyattach to a dock that secures the display lite. The dock may beconfigured to safely receive the display lite and support it at one ormore edges. The dock may also include electrical connections forpowering the display lite and/or for providing communication to thedisplay lite. In some cases, the dock may include electrical connectionsfor powering the EC device and/or for providing communication to the ECdevice. As noted above, communication may also be accomplishedwirelessly. In a particular example, the dock includes one or morecontrollers that, singly or together, control the EC device and thedisplay lite. Such controller or controllers may also be providedoutside of a dock, in another type of framing, on a lite, in a secondaryseal area, offboard the EC window, etc. The dock may be implemented as aframing for the display lite. Any of the framing examples shown hereinmay be modified to include such a dock. Additional examples of docks andother framing are described in U.S. patent application Ser. No.14/951,410, titled “SELF-CONTAINED EC IGU” and filed on Nov. 24, 2015,which is herein incorporated in its entirety.

In various examples, a framing system that secures a display liteincludes a structure for securing the display lite proximate an ECwindow, and wiring for providing power to the display lite. The framingsystem may further include wiring for providing communication to thedisplay lite, wiring for providing power to an EC window and/or windowcontroller, and wiring for providing communication to the EC windowand/or window controller. In these or other embodiments, the framingsystem may include wireless transmitters and/or receivers fortransmitting and/or receiving wireless control information that may becommunicated to the display lite and/or the electrochromic window/windowcontroller. The framing system may also include a number of othercomponents useful for an electrochromic window such as various sensors,cameras, etc.

In some embodiments, a framing system supporting a display lite isconfigured to be installed proximate existing framing that alreadysecures an electrochromic window. The electrochromic window isessentially being retrofitted to include the display lite in thisexample. In some such cases, the framing may include control hardware tointerface with the existing EC window. Such control hardware may usewireless communication to control the EC window in some cases.

Generally speaking, the framing system/dock/similar hardware may bereferred to as an apparatus for mounting an electronic device onto anoptically switchable window. The electronic device is a display in manycases (e.g., a display lite or other display), and may or may not betransparent. The electronic device may also be any number of otherdevices, including but not limited to a window controller, user inputdevice, etc. In some cases, the apparatus may mount more than oneelectronic device onto the optically switchable window.

In some cases, the display and the EC window may be controlled in tandemto enhance user experience. For instance, the display may be controlledin a way that takes into account the optical state of the EC window.Similarly, the optical state of the EC window may be controlled in a waythat takes into account the state of the display. In one example, the ECwindow and display may be controlled together in order to optimize theappearance of the display (e.g., such that the display is easy to see,bright, readable, etc.). In some cases, the display is easiest to seewhen the EC window is in a darkened tint state. As such, in some cases,the EC window and display may be controlled together such that the ECwindow goes to a relatively dark tint state when the display is used, orwhen the display is used and certain conditions are met (e.g., withrespect to timing, weather, light conditions, etc.).

In some embodiments, a first controller may be used to control theoptical state of the EC window, and a second controller may be used tocontrol the display. In another embodiment, a single controller may beused to control both the optical state of the EC window and the display.The logic/hardware for such control may be provided in a singlecontroller or multiple controllers, as desired for a particularapplication.

FIG. 15 illustrates one configuration of how the architecture of how anon-glass transparent controller can be implemented. The on-glasscontroller transparent display 1502 is used to display controlapplications in a graphical user interface (GUI) format. The transparentdisplay is in communication with the window controller 1504, eitheronboard or offboard as depicted below. A node controller 1506 is usedfor display monitoring and function. The node controller communicateswith a master controller 1508 for controlling the EC functions, etc.,which in turn communicates via the cloud with APIs. The windowcontroller may include RF radio, temperature sensors and control andBluetooth capability. Transparent on-glass controller displays can be,e.g., as commercially available Lumineq® transparent displays from BeneqOy, of Finland, as described on their commercial website(http://beneq.com/en/displays/products/custom). When a window controlleris connected to a local area network (e.g., a local network provided viawindows) or connected to the internet, the transparent display and otherglass functions can be controlled in some cases, through a web-basedapplication or another application configured to communicate with thewindow control network. Such applications can be run on, e.g., phones,tablets, or desktop computers.

Applicant's previously described window control technology architecturecan, in some cases, include a daughter card containing I/O for driving atransparent display (whether on-glass controller and/or if a full windowsize display/controller). Embodiments may also include an onboardantenna. The antenna may be an on-glass antenna, e.g., fractal and/orantenna suites scribed into a transparent conductive oxide layer on alite of an IGU. Antennas are used for various functions, including RFtransmission/reception. Various EMI blocking coatings may also beincluded in embodiments.

FIGS. 16 a and 16 b depict an EC IGU 1602 with an IGU connector 1604 forEC, antenna, and video applications. An IGU connector may include asingle cable that supports each of these applications, or in some cases(such as depicted in FIGS. 16 a and 16 b ) an IGU connector may includemore than one connector, each connector being used to support adifferent application of the EC IGU. For example, a 5-pin connector 1610may be used to support EC functionality while a coax cable 1608 maysupport wireless communications (e.g., via window antennas) and an MHLconnector 1608 (or I2C) may provide a video signal for the transparentdisplay. Some embodiments include wireless power and control, which may,in some cases, obviate the need for one or more wired connectors.

Certain embodiments described herein combine the strength of an existingbuilding operating system (BOS) infrastructure with antennas and displaytechnology for additional functionality. One example of suchfunctionality is providing power for window system components such aswindow controllers, radio, and display drivers. In some cases availablepower is provided at about 2-3 W per IGU. In some implementations, ECcontrol communication can be delivered over, e.g., standard 5 wire cablewith CANbus and power. For example, a CANBus may be operated at 100 kbpsor higher, e.g., up to about 1 Mbps if needed. In some embodiments, anARCnet network is employed, operating at up to about, e.g., 2.5 Mbps. Itmay do this in various network topologies including a linear controlnetwork. Delivering content for wireless and video requires relativelyhigh bandwidth communication interfaces, which can be made availablewith window systems that employ wireless transmission, UWB, or the like,each of which can be provide 500 Mbps or higher data rates. Often windowsystem installations have many windows, thereby allowing high datarates, particularly compared to sparse systems with an occasionaltransceiver as with current Wi-Fi technology.

The aspect of adding a display device to an EC window drives a need forgreater communication bandwidth, at least if the display content changesfrequently. Bandwidth requirements may be branched into two differentproducts, one for real-time display (e.g., a projector screenreplacement) with higher bandwidth, and one for lower bandwidthapplications (e.g., signage applications).

Frequently changing content like h.264 video conferencing requires 10Mbps (Ethernet) data rates for HD quality at 30 frames a second. Morestatic data, like a static advertisement can use the existing data path(CANbus) and available bandwidth (around what's required for glasscontrol) to load the content. The content can be cached, so data couldtrickle in over an hour, and then the display updates when the frame iscomplete. Other more slowly changing data like weather feeds, or salesmetrics also don't require high-speed data. Table 1 illustrates datacommunication bandwidths and associated applications.

TABLE 1 Data communication Bandwidths. Frames Audio Per Video h.263Quality Resolution Video Bitrate Bitrate second codec Profile Low 480 ×270 400 kbps 64 kbps 15/30 h.264 Baseline Med 640 × 360 800-1200 kbps 96kbps 30 h.264 Main High 960 × 540 800-1500 kbps 96 kbps 30 h.264 Main HD720 1280 × 720  1,200-4,000 kbps 128 kbps 30 h.264 Main HD 1080 1920 ×1080 4,000-8,000 kbps 192 kbps  30* h.264 Main or High

For signage applications, a transparent display integrated with an ECIGU offers a number of benefits. In some cases, windows may display a“follow me” guidance system to get you to your connecting flight in themost efficient way. This guidance system may be combined with a highaccuracy location awareness system that provides personalized serviceson a display based on the location of a traveler's mobile phone and thetraveler's boarding pass for the next flight. For example, thetransparent display may indicate: “this way to your next flight, Chuck”on panes of glass as you move along the corridor in the terminal. Inanother example, personalized displays on glass doors in a grocery storemay display what is on special within a buyers preference category. Inan emergency, the display windows may indicate safe exit routes, wherefire extinguishing equipment resides, provide emergency lighting, andthe like.

For real-time displays utilizing higher bandwidth data communication,the following examples are provided. In some cases, a video projectorcan be replaced with an OLED display and an EC IGU. The EC IGU can thendarken the room and/or provide the dark background necessary for goodcontrast on the display. In another example, windows with transparentdisplays can replace TVs in commercial and residential applications. Inanother example, a window having a real-time display can providereal-time health statistics for a patient as one looks through theoutside window. In this example, the patient retains the health benefitsof natural lighting while a doctor reviews patient's chart. In yetanother example, a real-time display can be used outside of a conferenceroom wall to, e.g., display scenery to people passing by as a privacyenhancement mechanism. Privacy provided by the display can augment theprivacy provided EC glass may darken over a period. In yet anotherexample, transparent displays can provide augmented heads-up displays incars or other forms of transportation.

OLED displays or similar (TFT, etc.) components of the EC IGU may haveother applications besides providing dynamic graphical content. Forexample, OLED displays can provide general illumination. A dark windowon a winter night simply looks black or reflects the interior light, butby using an OLED display, the surface can match the color of your wall.In some cases, the transparent display can display a scene that ispleasant to a building occupant and provides privacy. For example, awindow can display a screenshot of a sunny day from that exact windowfrom a camera integrated into the on glass or onboard window controller.In another scenario, a transparent display can be used to modify theperceived color of light transmitted through the EC lite portion of theIGU. For example, a transparent display may add a tinge of blue to aclear EC IGU, or a little color to a tinted IGU to make it more gray orneutral in tint. Light provided by the display can alter the color andspectrum of the incoming daylight into the room and consequentially thecomfort, visual perception, mood, and well-being of the occupant. Insome cases, the window control system and be configured to illuminatethe room and/or control other light sources (e.g., LED lighting) in aroom to alter the color or spectrum of light observed by an occupant.For example, a tintable window may, in some configurations, impart anunwanted blue hue to the occupant's space. In such cases, light emittedfrom a transparent display and/or another light source can be used toemit specific wavelengths of light to offset the blueness or anotherunwanted hue in the occupant's space due to the transmitted light fromtintable windows. In certain embodiments, control of tintable windowsincludes control over LED lighting and/or lighting provided by atransparent display to correct this perceived and rendered color toproduce an ambient lighting condition that the occupant would prefer.Some techniques using lighting provided by a transparent display and/orother light sources can change the CCT (correlated color temperature)and CRI (color rendering index) of the light in a room to have incominglight-color closer to natural light. Further methods of using interiorlighting to improve the perceived color and spectrum light within abuilding are described in U.S. patent application Ser. No. 15/762,077,filed Mar. 21, 2018, and titled “METHODS OF CONTROLLING MULTI-ZONETINTABLE WINDOWS,” which is herein incorporated by reference in itsentirety.

In another scenario, a transparent display can also be used to changethe reflected color of light on the walls of the occupant's interiorspace. For example, instead of looking at various hues of blue on awhite wall, the display can be tuned to make that color more uniformusing feedback from an inward facing camera of an onboard windowcontroller.

In certain embodiments, the transparent display component of the IGU isused to augment or replace conventional lighting in interior spaces (orexterior spaces if the display is bi-directional). For example, OLEDdisplays can be quite bright, and therefore can be used to light up aroom (at least to some degree) as an occupant walks into the space atnight (with occupancy sensing). In another embodiment, the transparentdisplay component is used to provide a color controlled light for an artgallery at a museum, e.g., a length of EC glass on one side of a wallused to illuminate artwork on the opposite wall.

A curtain wall of IGUs may all have transparent display technology ormay be a mixture of IGUs, some with and some without transparent displaytechnology. FIG. 17 depicts a façade of a building 1700 having IGUs withvarious capabilities. IGUs labeled 1702, 1704 and 1706 are for EMIblocking. IGUs labeled 1704 and 1710 are configured to provide cellularcommunications to the outside world, and IGUs labeled 1706 and 1710 areconfigured to offer WiFi and/or cellular services to occupants withinthe building. IGUs labeled 1708 only are configured for EC tinting anddo not block wireless communications.

In the example depicted in FIG. 17 , the top floor tenant either wantsto be isolated from the outside world or will provide their owncommunications (a cable modem for example). The building owner may,e.g., lease the outward facing antennas (1704) to the local cellularcompany as repeater towers. The fourth-floor tenant may want cellularservices in the building and control when they are available. The inwardfacing antenna (1706) emanate signals into the building on demand, butblocks exterior signals. The source of the signals may be the twooutward facing cellular antennas (1704). The third-floor tenant wants toblock all outside signals, but offer WiFi and cellular services tooccupants (1706). The second-floor tenant wants complete isolation, theymay have their own hardline (e.g., cable modem) connections, butotherwise are isolated. The ground floor is a lobby, EC glass (1708)allows exterior signals to pass through the glass, as well as offering acellular repeater (1710) to boost the available signals in the commonarea of the building.

Environmental Sensors

In some embodiments, an IGU may be equipped with environmental sensorsfor air quality monitoring. For example, an IGU may have one or moreelectrochemical gas sensors that transduce a gas concentration into acurrent flow through oxidation and reduction reactions between thesensor and the sensed gas. In some embodiments, metal oxide gas sensorsmay be used. Metal oxide sensors monitor a sensed gas concentration asfunction of electronic conductivity at the sensor. In some cases, an IGUmay be able to sense one or more of the six criteria pollutants (carbonmonoxide, lead, ground-level ozone, particulate matter, nitrogendioxide, and sulfur dioxide) that are monitored by the US nationalambient air quality standards (NAAQS). In some cases, IGUs may beequipped with sensors for detecting less common pollutants if there is aspecific safety concern at an installation site. For example, in afacility for semiconductor processing, sensors may be used to monitorfor fluorocarbons or to detect chlorine gas. In some cases, a sensor maydetect carbon dioxide levels as a form of occupancy sensor, e.g., to aidwindow control logic to determine heating and cooling needs of theinterior environment.

FIG. 18 depicts a cross-sectional view of an example atmospheric gassensor that may be located on an IGU. The environmental sensor 1800includes one or more first sensing units 1802 and one or more secondsensing 1804 units disposed on a substrate 1808. A cover 1818 may bedisposed over the first and second sensing units to protect sensingunits from large particles. Vias 1816 in the cover allow chemicalparticles 1830 to pass and be detected by the sensing units. The firstsensing unit 1802 senses chemical particles when particles pass throughthe vias 1816 and adhere to the first sensor electrode 1810, changingthe electrode's resistance. The second sensing unit 1812 has aninsulating layer 1822 between the second sensor electrode 1812 and thecover 1818 and senses a capacitance change when chemical particles passthrough the vias and adhere to the insulating layer 1822. In someembodiments, the environmental sensor is also integrated with acapacitive touch sensor 1806, where the insulating layer 1824 betweenthe touch sensor electrode 1814 may be the same material as theinsulating material used for the second electrode 1822. In some cases,insulating layers used for a capacitive touch sensor and a second sensorunit 1822 and 1824 are deposited during the same operation. Inembodiments where a touch sensor is integrated with an environmentalsensor, an insulating sidewall 1820 is used to prevent the chemicalparticles from diffusing into the region near the touch sensor electrode1814. Electrodes for the first and second sensing units may be made frommaterials such as Graphene, Carbon Nano Tube (CNT), Silver Nano Wire(AgNW), Indium Tin Oxide (ITO), etc. In some cases, the same materialused for a transparent conductive layer in an electrochromic device canbe used as for an electrode of the sensing unit or the touch sensor.

In some embodiments, an environmental sensor may be located on aninterior surface or an exterior surface of an IGU. The sensor units maybe very small such that even if they are made with opaque materials theycan still be inconspicuous. For example, the area of the first sensorelectrodes and/or the second sensor electrodes may be between about 1 μmand about 10 μm, or in some cases between about 10 μm and about 100 μm.In some cases, the substrate of an environmental sensor may be locatedon or embedded in a lite of an IGU. In some embodiments, the sensor isfabricated directly on top of an electrochromic device, and in somecases, an environmental sensor may be integrated into a transparentdisplay (e.g., an OLED display) as described herein where capacitivetouch sensors provide a means accepting for user input of a GUI providedby the transparent display. In some embodiments, an environmental sensormay be fabricated separately from an IGU and then may be bonded orattached to the interior surface, the exterior surface, or the frame ofan IGU. The sensor may be part of the window controller architecture;e.g., a window controller may be part of the window assembly. In somecases, sensors are located on or associated with on glass controllerswhich are described in U.S. patent application Ser. No. 14/951,410,titled “SELF-CONTAINED EC IGU” and filed on Nov. 24, 2015, which waspreviously incorporated in its entirety. In some cases, a sensor islocated on a frame, mullion, or adjacent wall surface. In certainembodiments, sensors in mobile smart devices may be used to aid inwindow control, e.g., as inputs to window control algorithms whensensors are available in smart devices also having window controlsoftware installed.

When installed, an environmental sensor is electrically connected to awindow controller or another controller having logic for collecting andprocessing data from the first sensing unit(s), the second sensingunit(s), and/or capacitive sensor(s). When located on an IGU, anenvironmental sensor may be electrically coupled to a controller viaconductive lines on the surface of a lite that connect to a pigtailconnector. As described elsewhere, pigtail connectors provide a pluginterface for electrically connecting a window controller to anelectrochromic device, window antennas, and/or other sensors andelectrical components of an IGU.

An environmental sensor may have a high sensing performance and be ableto discriminate between various gas pollutants. For example, the firstsensing unit may be reactive to first and second particles, while thesecond sensing unit may be reactive to second and third particles butnot the first particles. In this example, the presence of each of thefirst, second and third types of chemical particles in the air can bedetermined by evaluating a sensed response from the first sensingunit(s) in combination with the second sensing unit(s). In anotherexample, if a gas sensor has cross-sensitivity to a plurality of gasses,it may be difficult to determine what gas is being detected from asingle type of sensing unit. For example, if the first sensing unit hasa strong sensitivity to chemical A but is less sensitive to chemical B,the sensing logic may be unable to determine whether chemical A ispresent in a low concentration or chemical B is present in a highconcentration. When a second sensing unit is also used and has adifferent sensitivity to chemicals A and B (e.g., being more sensitiveto chemical B than to chemical A), then gas sensing logic may be able todiscriminate between the gasses. If the second sensing unit is locatedadjacent to the first sensing unit, it may be assumed that theconcentration of a sensed gas is similar at both units, and then thesensitivity difference of the two units may be used to discriminatebetween the two or more chemicals. In some cases, there may be three ormore types of sensing units on an IGU which may be used by sensing logicto discriminate between air pollutants. In some cases, an IGU may havemultiple gas sensors to compensate for sensor drift or instabilities.

Advanced Network Architectures

FIG. 19 a depicts the network architecture of current and commerciallyavailable window control systems. Each EC window has a window controller(WC), which in turn communicates with a network controller (NC), whichin turn communicates with a master controller (MC). Communication andcontrol can be done wirelessly, via a mobile app and/or via the cloud.Power is provided to windows through a trunk line cabling system, whichis modular and has a plug-n-play interface. In some cases, EC windowsare controlled based on sensor readings, e.g., based on the measuredlight intensities or based on measured temperatures. In some cases,windows are controlled via user input provided using the controlapplication. In other cases, windows can be controlled based on thelogic that considers the context, intensity, and angle of incidentlight. Once the desired tint level is determined, the drive commandstint the EC glass accordingly. In addition to automatic control based onlocal sensors an manual control provided through the controlapplication, Applicant's operating system can take into accountinformation provided by weather services, an occupant's physicallocation, and/or an occupant's schedule when determining the appropriatetint level for the window. Tint level adjustment may be performed inconjunction with indoor LED light luminosity & color adjustments andtemperature control.

FIG. 19 b depicts an embodiment having a proprietary cloud-basedsoftware that supports a window control network. The cloud-basedsoftware can store, manage, and/or process basic functions such assensing light, sensing air, sensing water, applying proximity context,executing tasks, controlling peripherals and providing an open interfacefor other applications. Transparent displays on the electrochromicwindows enhance the user experience by allowing users to interactdirectly with the glass, rather than using a mobile device or wall unit.By including atmospheric sensors (not depicted) controllers may analyzeair, water, light along with the occupant's context and/or personal datato create a personalized user experience. Glass controllers can createmesh networks with other digital systems in the building including LEDlights, HVAC, and air filters. The glass controllers can work inconjunction with these systems to keep an optimal ambient environmentwithin the building and act as ‘data wall’ between indoor and outdoorenvironments. Proximity detection and user recognition that is sensed orprovided by user input can trigger glass personalization. The glassnetwork specific internet-hosted software interacts via the cloud with,e.g., commercially available IoT digital systems, such as Nest, FB,Predix, IBM Watson++, etc. to augment and create integrated glassfunctions, including end-to-end data security and an IoT LTE network.Further embodiments include, partner eco-system powered glass functionswithin their application like building automation apps (e.g., Honeywell,J&J controls), workplace apps (e.g., iOffice), service and ticketingapps (e.g., Service Now, personalization apps (e.g., IFTTT), IoTecosystem—asset tracking (e.g., Oracle IoT cloud), Smart Lighting (e.g.,Bosch, Philips, GE), Digital Ceiling (e.g., Cisco) and the like.

FIG. 19 c depicts a network architecture where the electrochromic glassis 5G enabled. As in FIG. 19 b , the EC glass includes on-glass control,e.g., transparent display controller on surface 4 (occupant side of thewindow) as depicted. FIG. 19 d depicts the same architecture as in FIG.19 c , but in this case, the transparent display is large, substantiallycovering the viewable portion of the window on surface S4. Thisarchitecture may include, as in previous embodiments, autopersonalization of glass upon proximity detection of the occupant, assetlocation tracking near the glass, etc. using, e.g., proximity and motionsensors. Having 5G network speed from glass to the cloud enables highbandwidth applications like full-HD display technology.

A full HD Display on (or as) the inner glass surface allows for variousdigital content to be displayed. Displayed digital content may include,e.g., signage, communication, a work collaboration space connected to apersonal computer, or graphical user interfaces (GUIs) for controllingwindows, sensors, or HVAC systems. In certain embodiments, e.g., insignage applications, there is a transparent LED Mesh on surface S1 (notdepicted) displaying signage to those outside the building, while stillallowing for occupants to simultaneously see out of the building.Adjusting the EC glass component of the system allows for contrastcontrol for inward and/or outward projecting transparent displaytechnology. In one embodiment, a two-way transparent display on, or asS4, is used both for inside occupant display as well as signage forthose outside the building. In one example, office buildings windows areused for occupant needs (e.g., providing a display, providing controlfunctions, and communication), during business hours, but used forexternal signage during non-business hours.

Having such capabilities greatly expands the utility and value ofbuilding windows/facades. In another example, some of the windows orareas of individual windows are used for signage, and simultaneouslyother windows or areas of individual windows are used for occupantdisplay, communication and control functions.

In some embodiments, a controller such as a master controller in thenetwork may include a CDN proxy for signage content for local playback.Any controllers of the window control system (e.g., a master controller,network controllers, and/or leaf controllers) may contain a 5G LTEnetwork controller.

In some embodiments, the IGU is configured with an RF modulator modulefor Wi-Fi, GSM blocking/allowing. As depicted in FIG. 19 e , thisenables drone-safe buildings. As in previous embodiments, thisarchitecture can include embedded sensors (BLE, RF, proximity, light,temperature, moisture, 5G) on, in, or around the IGU, as depicted inFIG. 19 f . The IGU's window controller (e.g., an onboard controller)may be wirelessly powered (as illustrated by the lightning bolt in thefigure). This enables plug & play intelligent glass powered over a 5Gnetwork.

In some embodiments, the transparent display and/or another transparentlayer, includes photon cells (a type of photonic memory cell), which arecapable of storing not only power (photovoltaic function) but alsoinformation. A network of photon cells can enable onboard control wherethe window controller logic circuit is configured as a transparent grid,thus allowing for “sensor glass.” The transparent grid window controllercan be self-powered and mesh with other windows in the network as a trueplug and play system. The transparent window controller may or may notbe integrated or part of the transparent display component. Oneembodiment is an electrochromic IGU with a transparent on pane windowcontroller which receives power through photovoltaic cells.

In some embodiments, the IGU is configured with Light-Fidelity (Li-Fi)wireless communication technology, as depicted in FIG. 19 g . LightFidelity is a bi-directional, high-speed and fully networked wirelesscommunication technology similar to Wi-Fi. It is a form of visible lightcommunication and a subset of optical wireless communications (OWC). Incertain embodiments, Li-Fi is used as a complement to RF communication(Wi-Fi or cellular networks), while in some embodiments Li-Fi is used asthe sole means of data broadcasting to and from the IGU. As Li-Ficarries much more information than Wi-Fi, it allows for virtuallyunlimited bandwidth for communication between the IGU(s) and the controlsystem.

Using Li-Fi enables radio free buildings, e.g., to obviate occupantexposure to RF radiation. A Li-Fi powered glass network provides ultraHD to devices inside the building (including the transparent displaycomponent(s) of the IGUs described herein) paired with high-speedexternal radio networks.

Use Cases

The following description illustrates use cases associated withembodiments described herein. The description below may also includefurther embodiments. The architectures, configurations, hardware,software, etc. described herein allow for greatly expanded capabilitiesof building glass which therefore makes the building façade far moreuseful and valuable, e.g., not only to save energy, but also to increaseproductivity, promote commercial markets, and enhance occupant comfortand well-being. In the description below the term “the glass” may beused to mean the control network, the system architecture, the windowcontroller, interchangeably, to simplify the description. One ofordinary skill in the art would recognize that, along with the hardware,software, network and associated embodiments described herein, that “theglass” means the appropriate systems needed to perform whatever functionis described in the particular use case.

Proximity & Personalization

The IGUs and glass control architectures described herein detect theproximity of the occupant near the glass (e.g., via a proximity sensoron the window controller) and control the ambient environment (e.g.,window tint, lighting, HVAC of the area where the user currently is) tothe occupant's preferences. For example, occupant preferences providedby the occupant or learned from previous encounters with the occupantcan be stored by the window control system. The glass network canintegrate with the BMS as well as the occupant sensor networks (e.g.,Nest, Hue, SmartThings, as well as activity networks, e.g., IFTTT) andhas a cloud-based intelligent rule engine (e.g., a glass IFTTT ruleengine) for determining the right ambience parameters as well as actionsand timing based on the occupant's activity.

The glass provides a personalized communication channel across naturallanguage voice commands and messaging bots (e.g., text messages, instantmessaging, chat, email and the like) to get information about theambient environment as well as set the ambient environment to theoccupant's preferred settings. Full HD displays integrated into the IGUsenable these personalization channels to drive specific content on glasspanel for enabling collaboration as well as communication. The glass ismapped to a building network, personal area network and IT-app contextnetwork cloud to drive seamless proximity and personalization to users.Some examples of proximity-based communication channels are illustratedin FIGS. 20 a -20 b.

In another case, in a hospital setting, the glass can be programmed witha patient's care plan data. This is illustrated in FIG. 21 . That alongwith sunlight information allows the glass to set the appropriate tintlevel of the glass, with or without augmentation by the transparentdisplay component and/or interior lighting and HVAC, to create anambient environment that is best suited for the patient's recovery.Moreover, the glass can change the ambient environment based on thevisiting doctor's preferences, or a balance between what the doctorprefers and the patient needs. The doctor's visit may be scheduled, andthus the glass can make changes in anticipation of the doctor's visit ornurse's visit. The transparent display can be used by the medicalpractitioner to bring up the patient's medical records, order aprescription medication, confer with a colleague via video conference,display x-rays, play a prerecorded presentation or tutorial for thepatient, etc. The doctor may also use the glass to find and/or trackassets, such as a crash cart or other medical supplies needed for thepatient. The doctor may also use the glass to find a colleague, set up ameeting with the colleague or call the colleague to the patient's roomfor a consultation. In another example, the doctor may arrive at thepatient's intended room before the patent and use the glass to identifywhere the patient is. For example, it may be the case that the patienthas not left surgery, has been taken to the x-ray facility or forphysical therapy, is in the lobby with family, or is in the nurseryvisiting their newborn baby. The doctor may use the glass to call thepatient back to the room, or simply wish them well.

In another example, in an office setting, a meeting schedule may allowthe glass to control the ambient in a meeting room, includingappropriate light and heat levels, considering occupant's personalpreferences as well as taking into account how many occupants willattend the meeting, if there will be a presentation, etc. The glass mayautomatically order lunch for the attendees based on their preferences(e.g., based on other apps that the glass interacts within the cloud)such as favorite foods, local restaurants, known food allergies, etc.Moreover, the glass may also automatically block telecommunications intoand from the meeting room if the meeting is about highly sensitivematters. The glass can obviate the need for projectors and screens inthe meeting room. The glass itself can be used as the presentationmedium for displaying slide presentations, video conferencing,whiteboard functions having read/write capabilities and the like. Inthis latter function, using HD displays and high-speed communicationprotocols, the notes written on the glass can be simultaneouslytransferred to attendees personal computing devices, whether in themeeting room or remotely situated. The transparent display may, e.g., beenabled for a wide spectrum of colors for such note-taking. As seen fromthese examples, the glass becomes a “digital skin” of a building,serving as an environmental shield, a telecommunications hub, aproductivity enhancement, etc. Some examples of transparent displaysbeing used for business, collaboration, video conferencing, andentertainment are shown in FIGS. 22 a-22 e

In another example, the glass can interact with other systems such asIBM Watson. In some cases, the window control system can use sensors formonitoring real-time building temperature or moisture data to createlocalized weather pattern data that can be pushed to the cloud. In somecases, this data can also aide in weather prediction, e.g., incollaboration with other buildings equipped with the glass. Asillustrated in, e.g., FIGS. 22 a and 22 b , the glass may include anatural language translation system. Also, the glass has acloud-to-cloud integration. This allows the transparent display tointeract with an occupant's other apps, enabling collaboration andcommunication using a programmable rules engine. In this example,ambient light and temperature control are coordinated with thebuilding's BMS, and buildings can interact with each other. For example,if a building on the west side of town encounters a rainstorm or coldfront, this information can be communicated to a building on the eastside of town, which can then adjust the HVAC and/or glass inanticipation of the storm or cold front.

Service Optimization

Glass with transparent displays are listed as a digital asset in servicemanagement systems providing full-service lifecycle management duringdeployment and operations phase for seamless integration of the glass'operational management. This is achieved by integrating the glass'location and identification hierarchy into existing service lifecyclemanagement clouds like ServiceNow.

Industrial Automation

Glass equipped with a transparent display can be integrated into anindustrial workflow automation cloud as an ambient control digitalasset. The glass provides an interface for control and feedback intobusiness operation workflow systems providing best ambient conditionsfor that workflow. For example, a tint level for an eye specialist'swindows may be different than the tint level for a patient room and tintsetting for an unoccupied patient room. In another example, anindustrial process requires low lighting during a particular chemicalprocessing phase due to the sensitivity of the reactants to light orheat. The tint level and/or UV blocking of the glass is adjusted toaccount for the sensitivity during that process flow or, e.g., in thatpart of the building where the flow is happening. During periods whenthe flow is not happening, the glass changes the ambient conditions forimproved lighting or other desired conditions. In another example, theglass is typically in a dark tint in a computer server facility toreduce the heat load on the servers. If a server malfunctions, theoccupant can be notified by the transparent display on the glass. Theglass can display the location of the malfunctioning server to theservice technician, and the system may clear the glass near themalfunctioning server to provide lighting for the technician duringrepairs or replacement of the server. Once the server is back online,the glass may adjust the proximate windows back to their tinted state toonce again protect the servers from heat load.

Efficient Workplace

The glass in a building (e.g., in conference rooms, cafeterias, commonareas, executive suites, etc.) provides a distributed network digitalnodes integrated into workflow applications like email, calendaring,messaging (IM, email, text, providing policy driven ambient control forworkforce as part of their workday. When an occupant moves from a firstroom to a second room, items displayed via a transparent display to auser on in the first room may then be displayed to the user via theglass in the second room after authenticating the user. This allowsusers to easily access their own digital content while moving around thebuilding.

Glass Mesh Network

The glass surface will serve multiple functions. In one embodiment theglass acts as a power generating membrane, e.g., transparent solar cellsand/or photovoltaic cells convert sunlight into electricity for poweringthe glass. In another example, the glass serves as an RF grid, capableof receiving and transmitting omnidirectional RF signals based onconfigured policies. If photon cells are used, they can storeinformation and/or power enabling a number of embodiments (e.g.,self-powered windows, and wireless communication and power distributionnetworks). In some cases, digital security can be enabled viatransmission of high-frequency RF waves around the building skin toprotect against unwanted RF signals leaving the building (and hence dataleakage) to any receiver outside building as well as seizing RFcommunication for external RF communication driven by drones and otherUAVs. The glass can also trigger the blocking action via an automateddrone gun integrated into the glass or, e.g. in a rooftop sensor of thebuilding. FIGS. 23 a-23 c depict an interaction between glass andfriendly drones 2302 and a non-friendly drone 2304. In FIG. 23 a drones2302 and 2304 approach the glass and drone 2304 is identified ashostile. This could be, e.g., because the drone is trying to transmitsignals into the building and/or take pictures of the interior of thebuilding. As depicted in FIG. 23 b , the glass 2306 can darken to blockvisual penetration into the building and/or it can transmit RF signalsto jam the drone's operation and knock it out of the sky. This dronedefeating mechanism can be done selectively, as each window may havethis capability. The glass can thus remove the offending drone whileleaving the friendly drones to go about their work as shown in FIG. 23c.

In some embodiments, the glass can also detect potential intrudersoutside the building. For example, at 3 am a sensor may detect one ormore individuals outside a first-floor glass façade and alerts securitypersonnel as to their presence, potentially averting an intrusion intothe building. In another example, the glass automatically sensesbreakage and alerts a service technician that repairs are needed. Thisis illustrated in FIGS. 24 a and 24 b . In FIG. 24 a an unbroken window2402 monitors for a security or safety threat. In FIG. 24 b , the nowbroken window 2404 is detected, and appropriate action is taken—in thiscase, a notification may be sent to a repair technician. Breakage may bedetected by changes in current or voltage profiles of the electrochromiclite and/or the transparent display lite.

As described, the glass surface may serve multiple functions. In someembodiments, the glass acts as a mesh network that may be self-powered.In certain embodiments, a network of IGUs (windows) are powered byconventional wired power. In other embodiments, a network of IGUs ispowered wirelessly, e.g., using RF powering. In yet other embodiments, anetwork of IGUs is self-powered, using PV and/or photon cells. FIG. 25depicts an exploded view of an IGU having a first lite 2502 (e.g.,having an EC device coating), a solar panel grid (PV) 2504, an RFantenna grid 2506, a grid or layer of photon cells 2508, and second lite2510 (e.g., having a transparent display thereon). Some embodiments maynot include transparent display technology. Layers 2504, 2506, and 2508can be located on separate substrates within an IGU, or can be depositedon the interior or exterior surface of lite 2502 or lite 2510. A photoncell array or grid is used as a memory device. A network of photon cellscan enable onboard control where the window controller logic circuit isconfigured as a transparent grid, thus allowing for “sensor glass.” Thuswith photon cells, a transparent grid window controller is realized. Inthis embodiment, the transparent grid window controller is self-poweredand meshes with other windows in the network of IGUs. A transparentwindow controller may or may not be integrated or part of a transparentdisplay component. In some embodiments, the photon cell grid suppliessufficient power for the control functions of the electrochromic glass,but in other embodiments, as depicted, a PV array augments the photoncell grid. The RF antenna grid, capable of receiving and transmittingomnidirectional RF signals based on configured policies, allows forcommunication between IGUs and meshing functions.

Radio Transmission & Receiver

Policy and event-driven firewalling allowing and blocking of RF signalsbetween exterior and internal building environments. For example, theglass can provide a full GSM, Wi-Fi spectrum coverage for buildingoccupants. Blocking internal Wi-Fi network coverage outside thebuilding. This is illustrated in FIGS. 26 a and 26 b . In FIG. 26 a thewindows of a building are used to block devices located outside thebuilding from being able to connect to the buildings Wi-Fi network. InFIG. 26 b , the glass of a building is used to provide a wirelessnetwork within a building.

The table provided in FIG. 27 shows a number of configurations where anelectrochromic window, with or without transparent display technology,can serve as a signal blocking device and/or transmitter, e.g., awireless communication repeater that optionally can also block signalsfrom entering the interior of a building with IGUs so configured. Theasterisk in the table indicates alternative positions for a groundplane.

FIG. 28 depicts an electrochromic IGU 2800 (or laminate) that may act asa Wi-Fi passive signal blocking apparatus as well as a repeater Surface2 of the IGU 2800 has an EC device coating thereon (not shown).Selective exterior and interior radiating antennas (2802 and 2804) arepatterned on S1 and S4, with a Wi-Fi signal processing RF chip 2806 aspart of the window controller 2808. Surface 3 has a transparent RFshield (e.g., a ground plane that can be selectively grounded by thewindow controller). Therefore, this configuration can transmit andreceive Wi-Fi communications and block incoming communications ifdesired.

In certain embodiments, the EC window controller also serves as an RFspectrum master configurator, i.e., controlling incoming and outgoing RFcommunications as well as meshing functions with other IGU controllersand/or network and master controllers. Antennas may be etched ontransparent conductive coatings on one or more of the IGU's glasssurfaces. For example, omnidirectional antenna(s) etched on S1 forexterior network coverage to transmit internally into a building,omnidirectional antenna(s) etched on S4 for internal network coveragetransmitted to the external environment, and/or antenna(s) in and/or onmullions (window framing) providing full 360-degree coverage aroundglass of ‘configured’ spectrum & RF networks. Monopole or other RFantenna(s) can also be used in one or more of the aforementionedconfigurations. Such configurations provide blocking and repeaterfunctions and optionally for selected spectrum channels. Window antennasare further described in PCT patent application PCT/US17/31106, filedMay 4, 2017, and titled “WINDOW ANTENNAS,” which is herein incorporatedin its entirety.

Power Transmissions to Devices

The glass' RF transmitter transmits high power beacon frames toauthorized receivers providing continuous power over RF radio spectrum.

Asset Tracking

The glass' sensors detect movement of radio powered devices within thevicinity of the skin of the building providing real-time locationtracking mapped to access control or location policies ensuringun-authorized detection triggers an alert for remediation. Asillustrated in FIG. 21 , asset tracking can be useful in situations suchas helping a doctor locate a patient or medical equipment. In somecases, on-demand asset location mapping clouds, such as the Oracle IoTasset tracking cloud, will now have enhanced visibility of assetmovements with-in the perimeter of the building, because the skin of thebuilding is now digitized with the glass. Additional method and examplesof asset tracking are described in PCT patent applicationPCT/US17/31106, filed May 4, 2017, and titled “WINDOW ANTENNAS,” whichhas previously been incorporated by reference.

Transparent Display on Glass

A transparent light emitting diode screen can be etched on the exteriorand/or interior surface of the glass powered by a remote display busilluminating diodes for content getting served from cloud stored locallyat CDN controller for smooth rendering and also providing local gridcontrol for glass mesh network. This enables a number of capabilitiesfor windows described herein. In some cases, transparent displays canprovide on-glass tint control for the window as well as nearby zonepanels, as well as ambient environment sensor readings and status ofglass panel tint or other functions.

In some embodiments, external facing transparent displays, enable theexterior of the building to be converted into a building-size digitalcanvas. The exterior digital canvas can be used for displayingadvertisements and other digital content as depicted in FIG. 29 . Incertain embodiments, the occupant's view of the outside is maintainedeven when the outside of the glass is used as a display. The occupantmay also use the inside surface of the glass as a display. In someembodiments, an HD transparent display on or as the inboard lite isequipped with touch and gesture sensors or microphones for receivinguser inputs—converting the surface of the glass into a digitalwhiteboard for impromptu ideation sessions, meetings, and othercollaborative efforts. In some cases, a transparent display may be useda video conference pane, may display information from connectedapplications, or may provide entertainment (e.g., by pairing with andproviding information from a user's personal device enablingover-the-air casting to the glass surface).

Glass Digital Twin

Programmatic representation of the glass for applications to utilize theglass as a programmable surface allows various automated workflows. Insome cases, content may be auto-scaled for best rendering on the glassbased on the window's tint level. For example, a dynamic contentmanagement system can determine the best pixel transparency, depth, andcolor contrast for the content based on the ambiance surroundings of theglass panel. If, e.g., a car is parked outside the panel and reflectssunlight on the panel, the panel will need darker tinting to providesufficient contrast to the transparent display. In some cases, standardprogramming constructs can be used for modeling glass into digitalsystems. This may be, e.g., based on the availability of standard modelswithin application transport protocol headers. For example, HTTP/Sallows for auto-detection of glass as the edge of the digital networkthereby mapping the edge to standard templated operations allowed on theglass. An example is listed below.

<viewglass> <type:standard-panel> <function: tint> <level: 1-4><default-state: 1>  <type:display-panel> <function: external-led><content-src: URL> <display-resolution: UHD> <tint-level: 1-4><brightness: 0-100> <transparency: 0-100> <default-state: display-logo><surface: 1 or 4> <gesture: yes | no> <gesture-type: touch | motion><sensors: yes | no> <type: temp | proximity | light | RF><per-sensor-data-values> </viewglass>

Cellular Communications

As discussed, antennas with windows allow the glass to be used as a cellrepeater, making buildings into cell towers (as well as boosters forcell traffic internal to the building). This, along with 5G capabilitiesas described, obviates the need for obtrusive cell towers, especially inurban areas. FIG. 30 a depicts current cellular infrastructure. FIG. 30b depicts an improved cellular infrastructure that makes use ofbuildings having windows with antennas that can replace or work inconjunction with existing cell towers. Buildings equipped with suchwindows have the potential to greatly expand the coverage of cellularnetwork in dense urban areas.

Glass Cleaning and Maintenance

Sensors in or on the glass can, in some cases, detect dust level onglass and/or graffiti. In some cases, a window control system can informa cleaning scheduling system to schedule cleaning once dust level hasreached a threshold value, or when graffiti is detected. Windowsdescribed herein may have self-cleaning type coatings on the outboardlite to aid in maintaining clear views, such as titanium dioxidecoatings that catalyze breakdown of organic contaminants and allow therain to remove debris.

Glass Façade for Data Storage (Memory) and Networks

Since photon cells (sometimes called photon sensors) can store energyand data, and onboard window controllers or associated network or mastercontrollers may have significant storage and computing horsepower, thebuilding skin, the glass itself in the former example, can be used asdata storage cells. Since large buildings may have tens or hundreds ofthousands of square feet of glass on the façade, this can account forsignificant storage and/or computational power that can be used forpurposes other than tinting the windows and displaying information. Forexample, besides data storage for a building occupant, the glass can beused as an external network providing connectivity to the internet orforming in-building intranets (e.g., on the side of the building, floorof the building, rooms in the building, etc.). This is illustrated inFIG. 31 . The glass, 3102 can act as a bridge between an ultra-highspeed external network 3104 to many intra-building high-speed networks3106 and 3108 for voice, video and data communication. Moreover, byvirtue of piezoelectric elements and/or PV cells, the glass can generateenergy from the wind and or solar energy and supply power to the memoryand/or network transmission infrastructure. In some cases, a windowcontroller may have a battery for storing generated energy.

CONCLUSION

It should be understood that the certain embodiments described hereincan be implemented in the form of control logic using computer softwarein a modular or integrated manner. Based on the disclosure and teachingsprovided herein, a person of ordinary skill in the art will know andappreciate other ways and/or methods to implement the present inventionusing hardware and a combination of hardware and software.

Any of the software components or functions described in thisapplication, may be implemented as software code to be executed by aprocessor using any suitable computer language such as, for example,Java, C++ or Python using, for example, conventional or object-orientedtechniques. The software code may be stored as a series of instructions,or commands on a computer-readable medium, such as a random-accessmemory (RAM), a read-only memory (ROM), a magnetic medium such as ahard-drive or a floppy disk, or an optical medium such as a CD-ROM. Anysuch computer readable medium may reside on or within a singlecomputational apparatus, and may be present on or within differentcomputational apparatuses within a system or network.

Although the foregoing disclosed embodiments have been described in somedetail to facilitate understanding, the described embodiments are to beconsidered illustrative and not limiting. One or more features from anyembodiment may be combined with one or more features of any otherembodiment without departing from the scope of the disclosure. Further,modifications, additions, or omissions may be made to any embodimentwithout departing from the scope of the disclosure. The components ofany embodiment may be integrated or separated according to particularneeds without departing from the scope of the disclosure.

Although the foregoing embodiments have been described in some detailfor purposes of clarity of understanding, it will be apparent thatcertain changes and modifications may be practiced within the scope ofthe appended claims. It should be noted that there are many alternativeways of implementing the processes, systems, and apparatus of thepresent embodiments. Accordingly, the present embodiments are to beconsidered as illustrative and not restrictive, and the embodiments arenot to be limited to the details given herein.

What is claimed is:
 1. An apparatus for display, the apparatuscomprising: a tintable window comprising an electrochromic device andone or more lites; and a transparent display configured to display animage or a graphical user interface to a user, the transparent displaybeing disposed on one of the lites between the electrochromic device andthe user, the transparent display comprising an organic light emittingdiode (OLED) display, a thin film transistor (TFT) display, anelectrophoretic display, an electrowetting display, or a liquid crystaldisplay wherein: the transparent display and the tintable window areconfigured to have a symbiotic relationship, the symbiotic relationshipcomprising one or both of the electrochromic device being configured asa contrast element to aid visualization of the transparent display andthe transparent display being configured to augment the color, hue andtransmittance of the electrochromic device.
 2. The apparatus of claim 1,wherein the tintable window comprises a first lite, a second lite, andan electrochromic device disposed on the first lite, and wherein thetransparent display is disposed on and/or registered with the secondlite.
 3. The apparatus of claim 1, wherein the transparent display is apixelated display.
 4. The apparatus of claim 1, wherein the transparentdisplay is an organic light emitting diode (OLED) display.
 5. Theapparatus of claim 1, wherein the transparent display is anelectrowetting display comprising a plurality of pixels, wherein eachpixel comprises at least one cell that can be oscillated between atransparent state and an opaque state.
 6. The apparatus of claim 1,wherein the transparent display includes a passive coating that issubstantially transparent to an observer and reflects projected light.7. The apparatus of claim 1, wherein registration of the transparentdisplay with the tintable window includes the transparent display beingdisposed fully or partially coextensive with the tintable window.
 8. Theapparatus of claim 1, wherein registration of the transparent displaywith the tintable window includes the transparent display and the windowbeing configured for symbiotic utilization.
 9. The apparatus of claim 1,wherein the transparent display is disposed fully or partiallycoextensive with the tintable window and the transparent display and thetintable window are configured to have the symbiotic relationship. 10.The apparatus of claim 1, wherein the symbiotic relationship includesthe tintable window and the transparent display being configured tocommunicate status of the tintable window and of the transparent displayduring operation.
 11. The apparatus of claim 10, wherein the statusincludes (a) tinting status of the tintable window in conjunction withcontent displayed by the transparent display and/or (b) color, hue,transmittance, and/or switching speed of the tintable window inconjunction with content displayed by the transparent display.
 12. Theapparatus of claim 1, wherein control instructions control an opticalstate of the tintable window based at least in part on an optical stateof the transparent display.
 13. The apparatus of claim 1, wherein anetwork is configured to transmit user input for controlling an opticalstate of the transparent display and/or of the tintable window.
 14. Theapparatus of claim 13, wherein the network is configured to operativelycouple to a mobile device of the user and to the web, and wherein theinput to control the optical state of the transparent display and/or ofthe tintable window are based at least in part on a user instructionfrom the mobile device in communication with a web-based application.15. The apparatus of claim 13, wherein the network is (A) configured tooperatively couple to a microphone and transmit the user input obtainedvia the microphone, (B) configured to operatively couple to a camera andtransmit the user input obtained via motion detection using the camera,and/or (C) configured to operatively couple to a touch sensor andtransmit the user input obtained via the touch sensor.
 16. The apparatusof claim 13, wherein the network is configured to (i) operativelycoupled to an environmental sensor, and (ii) transmit instructions tocontrol an environment of a building in which the tintable window isdisposed based at least in part on measurements of the environmentalsensor.
 17. A system for display, the system comprising: a networkconfigured to: (A) operatively couple to a tintable window comprising anelectrochromic device and one or more lites and to a transparent displayconfigured to display an image or a graphical user interface to a user,the transparent display being disposed on one of the lites between theelectrochromic device and the user, the transparent display comprisingan organic light emitting diode (OLED) display, a thin film transistor(TFT) display, an electrophoretic display, an electrowetting display, ora liquid crystal display, and (B) transmit instructions to control anoptical state of the tintable window and/or the transparent displaywherein: the transparent display and the tintable window are configuredto have a symbiotic relationship, the symbiotic relationship comprisingone or both of the tintable window being configured as a contrastelement to aid visualization of the transparent display and thetransparent display being configured to augment the color, hue andtransmittance, of the tintable window.
 18. The system of claim 17,wherein the network is configured to receive input via a mobile devicein communication via a web-based application.
 19. The system of claim17, wherein the network is configured to operatively couple to one ormore sensors.
 20. The system of claim 19, wherein the network isconfigured for transmitting instructions received through sound, touchand/or gesture recognized at least in part by using the one or moresensors.
 21. An apparatus comprising at least one controller configuredto: (A) operatively couple to a tintable window comprising anelectrochromic device and one or more lites and to a transparent displayconfigured to display an image or a graphical user interface to a user,the transparent display being disposed on one of the lites between theelectrochromic device and the user, the transparent display comprisingan organic light emitting diode (OLED) display, a thin film transistor(TFT) display, an electrophoretic display, an electrowetting display, ora liquid crystal display, and (B) control, or direct control of, anoptical state (a) of the tintable window and (b) of the transparentdisplay wherein: the transparent display and the window are configuredto have a symbiotic relationship, the symbiotic relationship comprisingone or both of the tintable window being configured as a contrastelement to aid visualization of the transparent display and thetransparent display being configured to augment the color, hue andtransmittance of the tintable window.
 22. The apparatus of claim 21,wherein the at least one controller is a plurality of controllersforming a hierarchical control system comprising at least threehierarchical control levels.
 23. The apparatus of claim 21, wherein theat least one controller is configured to display, or direct display of,the graphical user interface on the transparent display.
 24. Theapparatus of claim 23, wherein the graphical user interface includesoptions for controlling the optical state of the window and/or anotherwindow.
 25. The apparatus of claim 21, wherein the transparent displayis an organic light emitting diode (OLED) display.
 26. The apparatus ofclaim 25, wherein the at least one controller is configured to control,or direct control of, the optical state of the OLED display to providelight to an interior environment and/or to an exterior environment of abuilding in which the OLED display is disposed.
 27. The apparatus ofclaim 21, wherein the at least one controller is configured to control,or direct control of, the optical state of the tintable window based atleast in part on the optical state of the transparent display.
 28. Theapparatus of claim 21, wherein the at least one controller is configuredto control the optical state of the transparent display based at leastin part on a user input.
 29. The apparatus of claim 28, wherein the atleast one controller is configured to (i) receive user input from amobile device in communication with the controller via a web-basedapplication, and (ii) operatively couple to the mobile device.
 30. Theapparatus of claim 28, wherein the at least one controller is configuredto (i) operatively couple to a microphone, and (ii) receive, or directreceipt of, the user input via the microphone.
 31. The apparatus ofclaim 28, wherein the at least one controller is configured to (i)operatively couple to a touch sensor, and (ii) receive, or directreceipt of, the user input via the touch sensor.
 32. The apparatus ofclaim 28, wherein the at least one controller is configured to (i)operatively couple to a camera, and (ii) receive, or direct receipt of,the user input via detecting motion using the camera.
 33. The apparatusof claim 32, wherein the motion comprises a user gesture.
 34. Theapparatus of claim 21, wherein the at least one controller is configuredto (i) be operatively coupled to an environmental sensor, and (ii)control, or direct control of, an environment of a building in which thetintable window is disposed based at least in part on measurements ofthe environmental sensor.
 35. The apparatus of claim 34, wherein theenvironmental sensor is configured to detect at least one chemical. 36.The apparatus of claim 35, wherein the environmental sensor comprises agas sensor.
 37. A non-transitory computer readable medium includingprogram instructions, the instructions, when read by one or moreprocessors, causing the one or more processors to execute operationscomprising: controlling, or directing control of, an optical state of atintable window, the tintable window comprising an electrochromic deviceand one or more lites, and of a transparent display configured todisplay an image or a graphical user interface to a user, thetransparent display being disposed on one of the lites between theelectrochromic device and the user, the transparent display comprisingan organic light emitting diode (OLED) display, a thin film transistor(TFT) display, an electrophoretic display, an electrowetting display, ora liquid crystal display, wherein the one or more processors areoperatively coupled to the tintable window and to the transparentdisplay wherein: the transparent display and the tintable window areconfigured to have a symbiotic relationship, the symbiotic relationshipcomprising one or both of the tintable window being configured as acontrast element to aid visualization of the transparent display and thetransparent display being configured to augment the color, hue andtransmittance of the tintable window.
 38. The non-transitory computerreadable program instructions of claim 37, wherein the one or moreprocessors are a plurality of processors forming a hierarchical systemcomprising at least three hierarchical levels.
 39. The non-transitorycomputer readable program instructions of claim 37, wherein theoperations comprise displaying, or directing display of, a graphicaluser interface on the transparent display that includes options forcontrolling the optical state of the window and/or another window. 40.The non-transitory computer readable program instructions of claim 37,wherein the operations comprise controlling, or directing control of theoptical state of the tintable window based at least in part on theoptical state of the transparent display.
 41. The non-transitorycomputer readable program instructions of claim 37, wherein theoperations comprise receiving, or directing receipt of, user input forcontrolling the optical state of the transparent display and/or of thetintable window.
 42. The non-transitory computer readable programinstructions of claim 41, wherein the operations comprise controlling,or directing control of, the optical state of the transparent displaybased at least in part on the user input received from a mobile devicein communication via a web-based application, and wherein the one ormore processors are configured to operatively couple to the mobiledevice.
 43. The non-transitory computer readable program instructions ofclaim 41, wherein the one or mor processors are configured to: (A)operatively couple to a microphone and the operations comprise receivingor directing receipt of the user input via the microphone, (B)operatively couple to a camera and the operations comprise receiving ordirecting receipt of the user input via motion detection using thecamera, and/or (C) operatively couple to a touch sensor and theoperations comprise receiving or directing receipt of the user input viathe touch sensor.
 44. The non-transitory computer readable programinstructions of claim 41, wherein the operations comprise controlling,or directing control of, an environment of a building in which thetintable window is disposed.
 45. A method comprising: controlling anoptical state (a) of a tintable window comprising an electrochromicdevice and one or more lites and (b) of a transparent display configuredto display an image or a graphical user interface to a user, thetransparent display being disposed on one of the lites between theelectrochromic device and the user, the transparent display comprisingan organic light emitting diode (OLED) display, a thin film transistor(TFT) display, an electrophoretic display, an electrowetting display, ora liquid crystal display, wherein: the transparent display and thewindow are configured to have a symbiotic relationship, the symbioticrelationship comprising one or both of the tintable window beingconfigured as a contrast element to aid visualization of the transparentdisplay and the transparent display being configured to augment thecolor, hue and transmittance of the tintable window.
 46. The method ofclaim 45, further comprising displaying a graphical user interface onthe transparent display that includes options for controlling theoptical state of the window and/or another window.
 47. The method ofclaim 45, further comprising controlling the optical state of thetintable window based at least in part on the optical state of thetransparent display.
 48. The method of claim 45, further comprisingreceiving user input for controlling the optical state (i) of thetransparent display and/or (ii) of the tintable window.
 49. The methodof claim 45, further comprising controlling the optical state of thetransparent display based at least in part on the user input receivedfrom a mobile device in communication via a web-based application. 50.The method of claim 49, further comprising (A) receiving the user inputvia a microphone, (B) receiving the user input via motion detectionusing a camera, or (C) receiving the user input via a touch sensor. 51.The method of claim 45, further comprising controlling an environment ofa building in which the tintable window is disposed.